Balanced truncation for linear switched systems 



Miliary Petreczky a , Rafael Wisniewski b , John Leth b '* 

a Univ Lille Nord de France, F-59000 Lille, France, and EMDouai, IA, F-59500 Douai, 

France 

b Aalborg University, Dept. of Electronic Systems, Fr. Bajers Vej 7, C3-211, DK-9220 

Aalborg Ost, Denmark 



Abstract 

In this paper, we present a theoretical analysis of the model reduction algo- 
rithm for linear switched systems from [l], 0] . This algorithm is a reminiscence 
of the balanced truncation method for linear parameter varying systems [3[. 
Specifically in this paper, we provide a bound on the approximation error in 
L 2 norm for continuous-time and l 2 norm for discrete-time linear switched 
systems. We provide a system theoretic interpretation of grammians and 
their singular values. Furthermore, we show that the performance of bal- 
anced truncation depends only on the input-output map and not on the 
choice of the state-space representation. For a class of stable discrete-time 
linear switched systems (so called strongly stable systems), we define nice 
controllability and nice observability grammians, which are genuinely related 
to reachability and controllability of switched systems. In addition, we show 
that quadratic stability and LMI estimates of the L2 and I2 gains depend 
only on the input-output map. 

Keywords: switched systems, model reduction, balanced truncation, 
realization theory. 



1. Introduction 

In this paper, we address certain theoretical problems which arise in model 
reduction of continuous- and discrete-time Linear Switched Systems (in this 
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work, referred to as LSS). 

To describe the contribution of this paper in more details, we will first 
present an informal overview of balanced truncation for linear switched sys- 
tem which appeared in [H, 0]. In fact, this method has already been used for 
linear time varying systems in [jjj]. 

Consider a linear switched system of the form 

f S(x)(t) = Ag(t)X(t) + B g (t)u(t), x(t ) = x m 

I y(t) = c q(t)X (t). W 

where 8(x)(t) = x(t) in continuous-time case, S(x)(t) — x(t + 1) in discrete- 
time case, A q , B q , C q are n x n, n x m and p x n matrices respectively, and 
the switching signal q maps time instances to discrete states in a set Q. 

We seek to replace the system E by another one of smaller dimension, 
but which still adequately approximates the input-output behavior of S. The 
methods for continuous-time and discrete time LSSs are similar. Specifically, 
for continuous-time systems, we define the following observability grammian 
as any positive definite > such that 

Vg G Q : A T q £ + £A q + C T q C q < 0. (2) 

Likewise, define a controllability grammian as a positive definite V > that 
satisfies 

Vg G Q : A q V + VA T q + B q B T q < 0. (3) 

By applying a suitable state-space isomorphism, the system can be brought 
into a form where V = £} = A = diag(o"i, . . . , a n ) are diagonal matrices and 
o\ > . . . > o n > 0. We will call the numbers o\ > . . . > a n > the singular 
values of the pair (V,J2). We also observe that (jj = a/ X^PM), where 
\i(V£?) > . . . > \ n (VJ2) are the ordered eigenvalues of V£l. Following the 
classical terminology, we will call a state-space representation balanced, if 
V = £? = A, where A is a diagonal matrix. We reduce the dimension of a 
balanced state-space representation by discarding the last n — r state-space 
components. 

Suppose that S is balanced. Consequently, the system matrices A q ,B q , C q 
of the reduced order system S are obtained by partitioning the matrices of 
the original system as follows 

cj = [<5f , *] , 



.4. 



Ag * 


, B q = 


B q 
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where A q , B q , C q are r x r, r x m and pxr matrices respectively. The perfor- 
mance of thisprocedure has been extensively tested by means of numerical 
examples in |2| . However, many theoretical questions remain open. 

Problem formulation 
We strive to find error bounds and to establish the invariance of the method 
with respect to state-space representation. In particular, we seek answers to 
the following questions: 

1. Error bounds 

Can we state a bound on the error between the original system £ and 
the reduced one £, using some metric ? In particular, can we extend 
the well-known result from the linear case, by proving that 

\\ Y *-Y%<2(a r+1 + --- + a n ), (4) 

where y s and F s are the input-output maps of £ and £ respectively, 
and ||.||2 denotes the L 2 norm of the switched system as defined in [4| 

? 

2. Invariance of the L 2 (for continuous-time) and l 2 (for discrete- 
time) norm estimates on state-space representation 

Is it possible to estimate the system norm in a manner which does not 
depend on the choice of the basis of the state-space ? 

3. Invariance of the grammians on state-space representation 

Under which conditions the controllability and observability inequali- 
ties 02]) and fl3J) and their discrete counterparts have solutions ? Does 
the existence of a solution to these inequalities depend on the choice 
of the state-space representation ? Can we characterize the set of ob- 
servability/controllability grammians in a way which does not depend 
on the choice of the state-space representation but only on the input- 
output map ? 

4. Invariance of the singular values on state-space representation 

Do the singular values of the system (i.e., the values 01, . . . , a n ) depend 
only on the input-output map of the system or do they also depend on 
the choice of the state-space representation. Do they have a system 
theoretic interpretation ? 
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5. System theoretic interpretation of the grammians 

What is the relationship between grammians and observability / con- 
trollability of the switched systems. In the linear case, existence of 
strictly positive observability/ controllability grammians implies observ- 
ability/controllability of the system. Does this extend to the switched 
case ? 

6. Preservation of system theoretic properties by the reduced 
system 

If the original system was reachable, observable, minimal, stable, etc., 
then will balanced truncation preserve these properties ? 

The motivation for the first problem is clear. The motivation for questions 
|2H3] is the following. The formulation of balanced truncation does not a 
priory exclude the possibility that the choice of the state-space representa- 
tion might influence the error bound. This would inhibit the applicability of 
the method, since the choice of the initial state-space representation is often 
circumstantial. In particular, the existence of a solution to the LMIs that 
are used for estimating L2 and I2 gains might depend on the choice of the 
state-space representation. In a similar manner, the existence of grammians 
and the values of the corresponding singular values might also depend on 
the state-space representation. Carrying on, Question is important for ob- 
taining a deeper theoretical insight and for answering Question EJ Whereas, 
Question [6] is important, because the reduced system is to be used for con- 
trol design, which is easier if certain important system-theoretic properties 
remain valid. 

Contribution of the paper 

In this paper, we prove the following results: 

• We prove the error-bound (j4j) for continuous and discrete LSSs. 

• We show how to estimate the L2 and 1% norms using LMIs in such a 
way that the obtained estimates do not depend on the choice of the 
state-space representation. 

• If a system admits an observability (controllability) grammian, then 
any minimal linear switched system which describes the same input- 
output map will admit an observability (controllability) grammian. 
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There is a one-to-one correspondence between controllability (resp. ob- 
servability) grammians of minimal systems which describe the same 
input-output map. This correspondence preserves the singular values. 
That is, the existence of grammians is a property of the input-output 
map and not of the state-space representation. For minimal state-space 
representations, the singular values are functions of the input-output 
map and not of the state-space representation. We also relate the 
largest singular value to the Hankel-norm of the system. 

As a byproduct, we also show that if an input-output map can be 
realized by a quadratically stable syste then any minimal realization 
of this map will be quadratically stable. 

• For minimal systems, if controllability and observability grammians 
exist, then they are necessarily strictly positive definite. 

For a class of discrete-time LSS, so called strongly stable LSSs, for 
which the matrix Yliq&Q ® ^ nas an its eigenvalues inside the open 
unit disc, the converse result also holds. Specifically, if nice controlla- 
bility and observability grammians are positive definite then the system 
is minimal. 

• Balanced truncation preserves quadratic stability. However, it does 
not necessarily preserve minimality. The fact that balanced truncation 
does not preserve minimality is a further indication of that the method 
might be very conservative. 

Related work The current paper is an extension of With respect to 
this work, the main differences are: 

1. The current paper contains detailed proofs. 

2. It presents results for both the continuous- and discrete-time LSSs. 

3. It provides a detailed exposition of the comparison between balanced 
truncation of switched systems and balanced truncation of linear pa- 
rameter - varying systems and systems with structured uncertainty. 



i.e. a system with a common quadratic Lyapunov function 
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A rich literature covers the subject of model reduction for switched sys- 



tems, BBHBHMy 

was explored in l], 0, 03, 
per was already described 
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In particular, balanced truncation 
The procedure dealt with in this pa- 



The error bounds of balanced truncation 
were investigated in [i| for linear parameter varying systems, in 17] for un- 
certain systems, and in [l4| for discrete-time jump linear stochastic systems. 
The proofs of the error bound in this paper are original and are inspired by 
similar proofs for time- varying systems 18]; yet, by introducing certain con- 
structions, we show that the results in this paper can be related to the above 
works. We will present a detailed comparison between the contribution of 



this paper and [3|, [17J, ll4( in £0 In short, the main differences follows. 
First, this paper deals explicitly with linear switched systems and does so 
for both discrete-time and continuous-time. As a consequence, the obtained 
results are less conservative than the ones of [1, H3, 14] when applied to lin- 
ear switched systems. Second, we address in great detail the independence 
of balanced truncation from the choice of state-space representation. 

The induced L 2 norm for switched systems was introduced and analyzed 
Nonetheless, 



in 



H, MM 



the focus in those works was not on the invari- 
ance of the computed estimates with respect to the choice of the state-space 
representation, addressed in this paper. 

Equivalent formulations of the concept of strong stability were used in 



2l|, |22|, but in a completely different setting. In |22| it was also stated that 
minimization preserves strong stability, but no proof was provided. 

We believe that the paper, as a whole, represents a new contribution, 
although some of the results of this paper have appeared in other contexts 
in literature. It provides a coherent exposition of the theoretical aspects of 
balanced truncation, and it does it in a self-contained manner. The presen- 
tation is tailored to linear switched systems. Finally, we believe that the 
relationship between the approach presented in the current work and bal- 
anced truncation methods of 0, 17, 14] is also interesting on its own right, 
since the corresponding system classes are rather far from linear switched 
systems. 

Outline: In we present the formal definition of continuous- and 
discrete-time LSSs. Furthermore, we give a brief overview of realization 
theory of LSSs. In ^J3j we state the formal definition of L 2 and l 2 norms, 
and grammians. Subsequently, we show the relationship between these con- 
cepts and conditions which guarantee their existence. In §H we show that 
quadratic stability, estimates of the L 2 and l 2 norms, existence of grammians 
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and the singular values of the system are all independent on the state-space 
representation. In §51 we discuss the system theoretic interpretation of gram- 
mians and their singular values. For the class of strongly stable discrete-time 
LSS, we show that the balanced truncation conserves strong stability and 
minimality of the representation. In §61 we present the proof of the error 
bound for balanced truncation. Finally in §0 we show how our results are 
related to the results on balanced truncation of uncertain systems, linear 
parameter varying systems and discrete-time Markov jump linear systems. 

Notation: The cardinality of a set S is denoted \S\. By N, we denote 
the set of natural numbers including 0, and by T = M + the set of non 
negative reals. We denote by ||x||2 the Euclidean norm of a vector x G M n . 
We denote by M fcx/ the set of all k X I matrices with real entries. For a 
symmetric matrix A G R nxn , we write A > 0, A < 0, A > and A < if 
A is strictly positive definite, strictly negative definite, positive semi-definite 
and negative semi-definite, respectively. By diag(ai, a 2 , . . . , a n ), we denote 
the n x n diagonal matrix with diagonal entries G K. Similarly, 

we denote by diag(^4 1 , . . . ,A/,) the n x n block-diagonal matrix, such that 
A G R n > xn > and n = J2i=i n i- 



We use the standard notation of automata theory 23]. For a set X, called 



the alphabet, we denote by X* the set of finite strings of elements of X, and 
by X w the set of infinite strings of elements of X. Elements of X* and X u 
are called finite and infinite words, respectively. That is, a typical element 
of X* is a finite sequence w • • • w^, w , . . . , G X and a typical element of 
X^ is an infinite sequence wqW\ ■ ■ ■ , such that Wq, W\, . . . G X. 

For a finite word w = w wi ■ ■ • Wk G X*, its length is denoted by \w\ and 
is equal k + 1. We denote by e the empty sequence (word) in X*. In addition, 
we define X + = X* \ {e}. 

We say that a map / : T — > R n is piecewise- continuous, if / has finitely 
many points of discontinuity on any compact subinterval of T, and at any 
point of discontinuity the left-hand and right-hand side limits of / exist 
and are finite. We denote by PC(T,M. n ) the set of all piecewise-continuous 
functions of the above form. The notation AC(T, R n ) designates the set of all 
absolutely continuous maps / : T — » R n . We denote by L 2 = L 2 (T,M. n ) the 
set of all Lebesgue measurable maps / : T — > M. n for which J °° < 
oo. For / G L 2 , we denote by H/H2 the standard norm of /, i.e., H/H2 = 



jo°° Wf( s )W 2 2 ds - Likewise, we denote by l 2 = / 2 (K n ) = Z 2 (N,M n ) the set 
of all sequences x = (xq,Xi, . . .) in R n with bounded l 2 norm, i.e., ||x||2 = 
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\/S°^o iT^ilH < oo. Finally, if M is a k x / matrix, then ||M||^ denotes 



the Frobenius norm of M, i.e., ||M||^ = yYli=i Sj=i My- For ^ a square 

matrix, i.e., k = I, we denote by tr(M) the trace of M, tr(M) = Y2i=i Mt,i- 

If z : N — 7- M r for some r, then denote by 8(z) the forward shift operator 
5(z)(t) = z(t + 1), V£ G N. If z G AC(T, W), then denote by 8{z) the 

dt 1 



derivative operator, i.e. = 4f (£). 



2. Linear switched systems 

Below, we formulate the definition of (continuous and discrete) linear 
switched systems and their system theoretic properties. The presentation is 



based on 24, |25l 



Definition 1 (Linear switched systems). A linear switched system with ex- 
ternal switching (abbreviated as LSS) is a tuple 

H = (n,Q,{(A q ,B q ,C q )\qeQ}), 

where Q = {1, . . . , D} for some fixed D G N \ {0} ; and for each q G Q, 
(A q , B q , C q ) G R nxn x R nxm x W xn . The number n G N, sometimes denoted 
dimS, is called the dimension of the LSS E. The elements of the set Q will 
be called the discrete modes, and Q will be called the set of discrete modes. 

The phrase "external switching" will be explained after we have intro- 
duced the notion of a solution. 

In the sequel, we use the following notation and terminology: the state 
space X = M. n , the output space Y = MP, and the input space U = M. m . More- 
over, to unify notation, we write U, Q, X and y to denote either L 2 (T, U), 
PC(T,Q), AC(T,X) and PC(T, Y) (in continuous-time) or l 2 (U), Q w , X u 
and (in discrete time). 

Occasionally, we write q(t) for the £th element q t of a sequence q G Q w . 
The same comment applies to the elements of , X u and Y^. 

With the conventions just stated, we collectively denote by || ■ || 2 either 
the I2 norm (in discrete-time) or the L 2 norm (in continuous-time). 

Definition 2 (Solution). A solution of the switched system (with external 
switching) E with initial state Xq G X and relative to the pair (u,q) eWx Q 
is by definition a pair (x, y) G X x y satisfying 

5x(t) = A q{t) x{t) + B q{t) u(t) a.e, x(0) = x 
y(t) = C q(t) x(t), [ ' 
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with a. e meaning almost everywhere and 8 denoting the derivative operator 
in continuous-time, and the forward shift operator in discrete-time. 

In both continuous and discrete-time, we shall call u the control input, q 
the switching signal, x the state trajectory, and y the output trajectory. 

Note that the pair (it, q) G U x Q can be considered as an input to the 
LSS. The phrase "external input" in the definition of an LSS refers to the 
fact that (it, q) can be chosen externally. Contrary to the situation when q is 
state-dependent and the value of q is assigned internally; for instance, when 
the state space is partitioned and a specific value of q is assigned for each 
cell of the partition. 

In the sequel, we only specify whether we consider continuous or discrete- 
time when this is not clear from the context. Remarkably, the particular case 
is frequently immaterial for reaching our conclusions. 

Definition 3 (Input-state and input-output maps). The input -state map 
X? and input-output map Y^ o for the LSS S, induced by the initial state 
x G X , are the maps 

UxQ^X; (u,q)^X*(u,q) = x, 
UxQ^y; (u,q)^Y*(u,q) = y, 

where (x, y) is the solution of S at Xq relative to (it, q) . 

A natural question is when a map / of the form 

f:UxQ^y (6) 

is indeed realized by an LSS. In the sequel, we refer to a map flS} as an 
input-output map. To address the above problem, we will fix a designated 
initial state for LSSs. Since we will mostly deal with exponentially stable 
LSSs, we will set the initial state to be zero. While this choice seems natural 
for the current paper, other choices might be more appropriate in other 
circumstances. Nonetheless, many of the results of this paper can be extended 
to the case of non-zero initial conditions. 

Definition 4 (Realization and equivalence). The input-output map of 

an LSS S is the input-output map Y^ = Y^ induced by the zero initial state. 
The LSS S is said to be a realization of an input-output map f of the form 
OH]), ifY^ = f . Moreover, the LSSs £i and S 2 are equivalent ifY^ 1 = Y 1 " 2 . 
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It is clear that any LSS is a realization of its own input-output map 
induced by the zero initial state. 

Definition 5 (Minimality) . The LSS E m is said to be a minimal realization 
of an input-output map f , if E m is a realization of f and if for any other 
LSS E which is a realization of f , dimE m < dimE. We say that E m is a 
minimal LSS , if it is a minimal realization of its input-output map Y Sm . 

Definition 6 (Observability). An LSS E is said to be observable, if for any 
two states x\ 7^ x 2 G X , the input-output maps induced by x% and X2 are 
different, i.e., Y£ ^ Y^. 

Let Reach XQ (E) C X denote the reachable set of the LSS E relative 
to the initial condition xq G X, i.e., Reach X0 (E) is the image of the map 

Definition 7 ((Span-)Reachability). The LSS E is said to be reachable if 
every state is reachable from the zero initial state, i.e., if ReachoiY,) = X. 
The LSS E is span-reachable if X is the smallest vector space containing 
ReachiT). 

We note that span-reachability and reachability are the same in continuous- 
time. 

As we now recall (in Theorem [1] below), there is a strong relation between 
minimality on one side and span-reachability and observability on the other. 

Definition 8. (Isomorphism) Two LSS 

Z 1 = {n,Q,{(A q ,B q ,C q )\qeQ}), 

and 

H 2 = (n,Q,{(A a qJ B a q ,C«)\qeQ}) 

are said to be isomorphic if there exists a non-singular matrix S G M. nxn such 
that 

VqeQ:A a q S = SA qi B a q = SB q , C a q S = C q . 

The matrix S is said to be an isomorphism from E x to E 2 and is denoted by 
S : Ei -> E 2 . 



The following theorem summaries various results on minimality, see [26 
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Theorem 1 (Minimality). A LSS realization is minimal, if and only if it 
is span-reachable and observable. All minimal LSS realizations of an input- 
output map are isomorphic. Finally, if Ei and E2 are two equivalent and 
minimal LSSs, then they are related by an LSS isomorphism. 



Remark 1. In \24 - \2d . \27l l a slightly different definition of input-output 
maps was used. There, an input-output map Y^ Xo o/E induced by the initial 
state xo was a map of the form Yz jXQ : PC(T, U) x (Q x T) + — > Y for the 
continuous-time case and Y^ tX0 : (U x Q) + — > Y for the discrete-time case. 
The relationship between Y S;X0 and Y^ is as follows. 

For the continuous-time case, consider a sequence w = (gi, t\) • ■ ■ (qk,tk) G 
(Q x T) + . The interpretation of w is as follows: the discrete mode qi is ac- 
tive for duration ti. Assume that w has the property that there exists no 
i = 1, . . . , k — 1 such that ti = t i+ i = 0. It is clear from 124 - \22] that Y^ tXo 



is uniquely determined by its restriction to the switching sequences satisfying 
this property. Any such switching sequence can be interpreted as a restriction 
of a signal q E Q to the interval [0, X) i=1 ij] such that ql^r 1 ^ ^tj] = Qi> 
g(0) = qo, i = 1, . . . , k. Conversely, for any signal q e Q, the restriction of 
q to a finite time interval can be interpreted as such a switching sequence. 
From the definition ofY-£ :Xo presented in f2~J . it follows that Y^ Xo (u,w) 
depends only on the restriction of u to [0, X)»=i^i]- ^ s eas V t° see that for 
any u G PC(T,U), there exists au E U such that on [0,5^ i=1 tj] u and u 
coincide. As a consequence, Ye jXQ (u, w) = Y^(u,q)(Yli=iU)- Hence, there is 
a one-to-one correspondence between Y% jXo and Y^. 

For the discrete-time case, Y^ !XQ ((u , q ) ■ ■ ■ (u t , q t )) = Y^(u, q)(t), where 
(u, v) is any element of U x Q such that u(i) = Ui and Vi = qi for all 
i = 0, . . . Since any element of (U x Q) + arises from some element of 
U x Q in this way, it follows that there is one-to-one correspondence between 
Yx,x and Y^. 

It then follows that two LSSs Ei and E 2 are equivalent according to Def- 
inition^ if and only i/V&n = Yihjh i- e - Ei and E 2 realize the same input- 



output map according to \2g, \2a . \22]. From the discussion above, it is also 



easy to see that the definitions of observability and span-reachability and min 



imality presented above coincide with those in 124 - \2d , \2a ]. This means that 



the results of I24 . \2d . \2jJ on minimal realization can indeed be used, despite 



the slight difference in the definition of input-output maps. 

Remark 2. Note that it is also possible to extend the notion of a Hankel- 
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matrix to switched systems (see §5.1?)) and show that existence of a realization 
is equivalent to the finiteness of the rank of the Hankel-matrix. In fact, the 
rank of the Hankel-matrix will give the dimension of a minimal realization. 
For the purposes of this paper these results are not directly relevant, the 
interested reader is referred to 124 - \2a . \22j- 

Observability and span- reachability of an LSS can be characterized by 
linear-algebraic conditions. To present these conditions, we introduce the 
following notation. 

Notation 1. Consider an LSS E = (n,Q,{(A q , B q ,C q ) \ q G Q})- For a 

sequence q G Q* , we write 



A 



A q2 A qi ifq = qi q 2 ---q k , 



where I n denotes the n x n identity matrix; and recall that e is the empty 
sequence. 

Let Q* n be the set of all words w G Q* of length at most n, 

Ql = { w e Q* | \w\ < n}. 
Furthermore, denote by M the cardinality of Q* n (M = \Q* \). Fix an ordering 



{t>i, . . . , vm} of the set Q* n . The next theorem is due to |28|, |25|, 126 



Theorem 2. 

Span-Reachability: The LSS H is span-reachable if and only if rank 7?.(S) 

n, where 



with B=[B U B 2 , 



A Vl B, A V2 B, . . . , A VM B 



d n X mDM 



B D ] G 



pnxDm 



Observability: The LSS E is observable if and only if rank 0(E) = n, 
where 



0(E) = (CA 



(CA 



T 

V2 ! j 



(CA 



1 T 



where C = [Cj C 



T 
2 • 



oDxn 
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The matrix 7£(E) (resp. 0(E)) will be called a span-reachability matrix 
(resp. observability matrix) of E. 

Remark 3. // a linear subsystem of an LSS E is observable (reachable), 
then E is observable (resp. span-reachable). Hence, by Theorem^ if a linear 
subsystem of E is minimal, then E itself is minimal. 



Remark 4. In ]2A, \M, \M] it is shown that kerO(E) = Oq^QveQ* 
andlm K(E) = Span{A v B q u \v E Q*,q E Q,u E R m }. 



ker C„A V 



Remark 5. Note that observability (span-reachability) of an LSS does not 
imply observability (reachability) of any of its linear subsystems. In fact, it 
is easy to construct a counter example [21]. Together with Theorem^ which 
states that minimal realizations are unique up to isomorphism, this implies 
that there exists an input-output map which can be realized by an LSS, 
but which cannot be realized by an LSS where all (or some) of the linear 
subsystems are observable (or reachable). 



Remark 6 (Duality between span- reachability and observability) . // E = 
(n, Q, {(A , B^, C ) | q E Q}), then define the dual system of E as E T = 
{n, Q, {{A?, Cj, Bj) | q E Q}). From Theorem^ it then follows that E 
is observable if and only if E T is span-reachable. Conversely, E is span- 
reachable, if and only z/S T is observable. That is, similarly to linear systems, 
reachability and observability are dual properties for LSSs. 



From [24j . |25| . |26| , we have the following algorithms for reachability and 
observability reduction, and minimal representation. 

Procedure 1. 

Reachability reduction: Assume that rank 7?.(E) = r and choose a basis 
bi, . . . ,b n of MJ 1 such that b±, . . . , b r span Im 7£(E). In the new basis, the 
matrices A q , B q ,C q , q E Q become as follows 



A„ 



< 



, C q — [Cf, C q ] , B q 



B 




(7) 



where A^- E 



l rxr ,Bf E 



rxm , and Cf E R pxr . As a consequence, E R = 
l r > {(^qS Bf', C R ) | q E Q}) is span-reachable, and has the same input- 
output map as E. 



Intuitively, E R is obtained from E by restricting the dynamics and the 
output map of E to the subspace Im 7£(E). 
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Procedure 2. 

Observability reduction: Assume that ker 0(E) = n — o, and let b\, . . . , b n 

be a basis in W n such that b 0+ i, . . . , b n span ker 0(E). In this new basis, A q , 
B q , and C q can be rewritten as 

,C q = [C°, 0},B q = \ B J , 

L q. 

where A° G R oxo ,B° G R oxm , and C g ° G R pxo . Consequently, the LSS 
S° = (o, Q, {(A® , B®, C^) | q G Q}) is observable and its input-output map 
is the same as that o/E. IfT, is span-reachable, then so is E . 

Intuitively, E is obtained from E by merging any two states x\, of E, 
for which C(E)xi = £>(E)x 2 . 

Procedure 3. 

Minimal representation: 

Transform E to a reachable LSS E R by Procedure^ Subsequently, transform 
E R to an observable LSS E M = (E R )° using Procedure [3 Then E M is a 
minimal LSS which is equivalent to E. 

3. Stability, grammians and £2 norms 

In this section, we briefly review the definition of controllability /observability 
grammians, £ 2 norm, and quadratic stability for LSSs. We also recall the 
basic relationships between these concepts. 

Definition 9 (Quadratic stability). An LSS 

Z = (n,Q,{(A g ,B g ,C q )\qeQ}) 

is said to be quadratically stable if there exists a positive definite matrix P > 
such that 

\/q £ Q : S(q, E, P) < 0, (8a) 

where 

• in continuous-time (Lyapunov equation) 

S(q,Z,P) = A q n P + PA q , (8b) 



A n 



A" 

A q A 
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• in discrete-time (Stein equation) 

$(q^P) = A T q PA q -P. (8c) 

It is well-known |29| that quadratic stability implies exponential stability 
for all switching signals. For our purposes quadratic stability is convenient, 
as it implies the existence of an £ 2 gain (Definition [TT]) and controllabil- 
ity/observability grammians. 

Definition 10. ( Controllability /observability grammians ) 

An observability grammian of £ is a positive definite solution B > of the 

following inequality 

Vg € Q : 0(q,E,B) < 0, (9a) 

where 

• in continuous-time 

0(q, E, B) = A T q B + BA q + CjC g , (9b) 

• in discrete-time 

0( qi E,B) = A^BA q + CjC q -B. (9c) 

A controllability grammian of S is a positive definite solution V > of 
the following inequality 

Vg G Q : C(q,E,V) < 0, (10a) 

where 

• in continuous-time 

C(q, £, P) = A q V + TM^ + B q B T q , (10b) 

• m discrete-time 

C(q, £, P) = + 5 9 5 9 T - P. (10c) 
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We will call the eigenvalues of the product VJ2 the singular values of the pair 
of grammians (V, J2) . 

Existence of a controllability or observability grammian does not imply 
quadratic stability. However, if in fllOap or ( 1§a|) we replace inequality by strict 
inequality, then existence of a positive definite solution to the thus obtaines 
LMIs is equivalent to quadratic stability. More precisely, using techniques 
from j3o[, one can show that 

Lemma 1. The following are equivalent: 

• (i) S is quadratically stable, 

• (ii) there exists =2 > such that Wq G Q : 0(g, E, J2) < 0, 

• (Hi) there exists V > such that \/q G Q : C(g, T,,V) < 0, 



The proof of Lemma [T] can be found in Appendix B 
Note that existence of controllability grammian does not imply control- 
lability, even if \Q\ = 1, i.e. we have the classical linear case. For a counter- 



example for the linear case, see [17 



To define the £2 norm for an LSS , we recall that 1 1 • | (2 denotes either the 
I2 norm (in discrete-time) or the L2 norm (in continuous-time). 

Definition 11 (|4|]). We say that Y s has an £ 2 gain 7 > if 

a) y s (M,g) belongs to L 2 (T,Y) (in continuous time case) or to ^iY) (in 
discrete time case) for all (n, q) EU x Q, and 

b) 

sup||F s (u,g)|| 2 <tN| 2 VugW. (11) 

q£Q 

IfY B has an £2 gain, then we define the £2 norm ofY^, denoted by ||^ s ||£ 2 , 
as the infimum of all 7 > such that (ITT)) holds. If F s does not have an £2 
gain, then we set ||^ E ||£ 2 = +00. 

Note that existence of a £2 gain of F s means that the outputs of S belong 
to L 2 (T, V) (cont. time) or hiY) (disc, time) respectively. We note that 
since u 1— > y s (w, q) is linear for each q, the £2 norm of Y^ can equivalently 
be defined as 

||F s || £2 = sup sup ||y s (w,g)|| 2 , 

q&Q \\u\\ 2 = l 
16 



whenever ||y s (w,g)|| 2 exists. In other words, ||^ s ||z; 2 is the supremum of 
the operator norms 

||F s (-,g)||= sup \\Y*(u,q)\\ 2 . 

[H[2=l 

Lemma 2. IfH is quadratically stable, then ffl2l) below has a positive definite 
solution P. 



VgG Q : G y {q,E,P) < 0, 



where 



(12a) 



in continuous time 



G 7 (g,E,P) 



A T q P + PA q + C^C q PB q 
BTP -7 2 / 



(12b) 



in discrete time 
G 7 (g,£,P) 



PA a + CjC — P. 



R T P A 

±j q l j-y q , ^ q j. ^ q 



A'qPBq 

B.rpB q - 7 2 / 



(12c) 



If a positive definite solution to ( 112]) exists, then for any (u, q) G U x Q, 
||y s (n, g)|| 2 «s defined and ||"^ E ||,c 2 < 7- 



The proof of Lemma [2] can be found in |Appendix C 



4. Invariance of state-space representation 

In the previous section, we defined quadratic stability, £ 2 gains, and 
grammians. The concepts were defined in terms of LMIs. We will show that 
the existence of a solution to those LMIs is a property of the input-output 
map. Furthermore, for equivalent minimal systems, the set of solutions are 
isomorphic. In order to formalize this result, we will introduce the following 
notation. 

Definition 12. For a LSS 

Z = (n 1 Q,{(A q ,B q ,C q )\qeQ}), 
define the following subsets of the set ofnxn strictly positive definite matrices 
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• S(£) is the "stability" set of all P > which satisfy flBD- 

• O(E) is the "observability" set of all £} > for which (Q holds. 

• C(£) is the "controllability" set of allV>0 for which (jTUl) holds. 

• For 7 > 0, let G 7 (E) be the set of all P > which satisfy (|12|) . 
Now, we can state the following result. 

Theorem 3. Let K fre any symbol from {S, O, C, G 7 }. 

1. If the LSS £ is such that K(£) 7^ 0, £/ien /or any minimal LSS E m 
which is equivalent to E, K(E m ) 7^ 0. 

2. If V £ C(E) ; G O(E), i/ien /or any minimal LSS E m which is 
equivalent to £, t/iere exzst V m G C(E m ) and ^ m G 0(E m ) ; stzc/i 
i/iai i/ie following holds: if o\ >,•••,> o~ n are the singular values of 
(V, J2) and \i >,...,> Afc are the singular values of (V m , J2 m ), then 
Cn-k+i <\i<<Ti,i=l,...,k,h = dim£ m . 

3. Let Ex and E 2 be two LSSs of dimension n and let S : £1 — > E 2 be an 
isomorphism between them. 7/K G {S, O, G 7 } then define M = S^ 1 G 

R nxn. Z J K = Q then de fi ne M = £T Then 

PeK(Ei) M T PMe K(E 2 ). (13) 

In particular, for any two minimal and equivalent LSSs £1 and £ 2 , 
i/iere exists a non singular matrix M such that (TT3"j) holds. 

The theorem above expresses that quadratic stability and existence of 
controllability/observability grammians are preserved by minimality. In fact, 
if one of these properties holds for a state-space representation, then it holds 
for any minimal state-space representation. From Theorem [3] it follows that 
it is sufficient to perform balanced truncation on minimal systems. This will 
be explained in detail in Remark [9j 

Corollary 1. For minimal LSSs, the singular values of grammians do not 
depend on the choice of state-space representation. Indeed, assume that £1 
is a minimal LSS, and consider the singular values o\ , . . . , a n for a choice of 
grammians (V\, £}\) 0/E1. Then for any minimal LSS E 2 which is equivalent 
to Ex there exists a pair of grammians (P 2 , =2 2 ) o/E 2 such that the singular 
values of ("P 2 , i2 2 ) are also o~i, . . . , a n . 
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For an LSS E, define 7(E) = inf{7 > | G 7 (E) 7^ 0}. Then clearly the 
£ 2 norm of the input-output map of E is at most 7(E). From Theorem El 
we obtain that 

Corollary 2. 

• For any minimal LSS E m which is equivalent to E ; 7(E m ) < 7(E). 

• // E i; i = 1,2, are two minimal and equivalent LSSs, then 7(Si) = 
7(S 2 ). 

As a consequence, the number 7(E), where E is minimal, depends only 
on the input-output map of y s . Note that 7(E) can be computed by solving 
a classical optimization problem. 

Proof of Theorem [3 The proof for both the discrete- and the continuous- 
time case are the same, hence we present both cases together. 

The proof of the last part of the theorem follows by an easy computation 
and by recalling that if Ei and E2 are two equivalent and minimal LSSs, then 
they are related by an LSS isomorphism. 

Next, we prove the first statement of the theorem. In order to make 
the proof easier, we denote by C(E) the set of all inverses of elements of 
C(E). Clearly, showing that C(E) 7^ =^ C(E m ) 7^ is equivalent to 
showing C(E) 7^ ==>- C(E m ) 7^ 0. Hence, in the sequel, we will show that 
K(E) 7^ K(E m ) 7^ for K G {S, C, O, G 7 }. To this end, it is enough 
to show that if K(E) 7^ and we apply Procedures [TH21 to obtain a minimal 
LSS E m , then K(E m ) 7^ 0. 

First, we show that the application of Procedure [T] preserves the non- 
emptiness of K(E). Recall the partitioning of A q from (J7]) and consider the 
corresponding partitioning of P 



P 



P2I P22 



A simple computation reveals that 
Lemma 3. If P e K(E) ; then P n G K(E r ) for K G {S,G 7 ,0,C}. 
The proof of Lemma [3] can be found in Appendix D| 



Next, we show that Procedure [2] preserves non-emptiness of K(E). We 
will use the duality between observability and reachability, explained in Re- 
mark [61 Define the dual system E T = (n, Q, {(A^, Cj, Bj) \ q G Q}). The 
following properties of the dual system E T hold. 
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Lemma 4. 



1. ForPeS(E) P- 1 G S(S T ), 

2. P £ O(E) P- 1 G C(E T ) and P G C(E) ^ P" 1 G 0(E T ). 
5. P G G 7 (E) <^=> 7 2 P-! G G 7 (E r ). 



The proof of Lemma H] can be found in Appendix E 

As a consequence, K(E) ^ if and only if K(E T ) ^ for K G {S, G 7 }, 
and O(E) ^ C(E r ) ^ 0, and C(E) ^ 0(E T ) ^ 0. From the 

definition of duality it follows that if E rt is the result of applying Procedure [1] 
to E T , then E^ = E D , where E Q is the result of application of Procedure [2] to 
E. Since Procedure [1] preserves non-emptiness of K(E T ), K G {S, G 7 , O, C}, 
we have that K(E) ^ =► K(E T ) ^ => K(E rt ) ^ =► K(E G ) ^ 0, 
K G {S,G 7 }, and C(E) ^ =}► 0(E T ) ^ 0(E rt ) ^ 

C(E ) ^ 0, and O(E) ^ =^ C(E T ) ^ C(E rt ) ^ 0(E ) ^ 
0. 

Finally, we show the second statement. Without loss of generality, we 
can assume that E m is the result of applying Procedure [1] and Procedure 
H to E. Consider a matrix pair (V',J2'), (P,^), V\3 G R kxk V, J3 E 
R nxn , V,V',£,£' > 0. Let Ai > ... > A n be the eigenvalues of V£ 
and let X x > . . . > X k be the eigenvalues of P £t . We write (V , £} ) ^ 
(P, if A; < n and A n _fc + , < A 4 < A^, i — 1, . . . , k. It is easy to see 
that ^ is a transitive relation. Hence, it is enough to show that if we apply 
Procedure [1] or Procedure [2] to E, then the resulting system will have a pair 
of controllability and observability grammians (P such that (P r< 

(P, J2). From Lemma H] it follows that it is enough to prove this only for 
Procedure [TJ 

Let Pn and J2?n be the upper left r x r sub-matrices of P = P _1 and in 
the basis described in Procedure[H Then Lemma [3] implies that P^ 1 G C(E r ) 
and B xx G 0(E r ). We claim that (P u \^u) r< (P, Indeed, notice that 
the eigenvalues of Pi2 and P^J^n are exactly the characteristic values of 
the regular matrix pencils (i? — AP _1 ) and (J2n — APn) respectively, see 



31|, Chapter X.§6]. But {£ n - APn) is just the pencil («0 - AP" 1 ) with 
n — r independent linear constraints which describe the orthogonal comple- 
ment of V*(E). Then from [3l], Chapter X.§7, Theorem 14], it follows that 
(Pn\£u)±(V,J2). ' □ 
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5. System-theoretic interpretation of grammians and their singular 
values 



In this section, we provide a system theoretic interpretation of grammians 
and their singular value. To this end, we link them to observability, span- 
reachability and Hankel-norms. 

Theorem 4. IfV be a positive semi-definite matrix which satisfies (}9a|) and 
£ is span-reachable, then V is positive definite. Similarly, if J2 is a positive 
semi-definite matrix which satisfies fllOal) and £ is observable, then £? is 
positive definite. 

The proof of Theorem H] is based on the following results, which are in- 
teresting on their own right. 

Lemma 5. Assume that J2 > satisfies Vg G Q : 0(q, E, i?) < 0. Then for 
all q G Q, t > 



x 1 Bx > 



Jt\\Y?(0,q)(s)\\lds (cont.) 

Etoiin s (o,<z)(s)III (disc.) 



Lemma 6. Assume that V > is a solution to Vg G Q : C(q, S,"P) < 0. 
T/ien /or all (u, q) G W x Q, and t > 



Z^fc=0 M "*ll2 i 



where x = X^fw, 



The proofs of Lemma and can be found in|Appendix F| and | Appendix G 



Proof of Theorem [^} We prove the statement for the observability by con- 
tradiction. Assume that there exists x G M n \ {0} such that x T J2x = 0. By 
Lemma 0, this implies that for all q G Q, the map Y^(0,q) = and thus 
y£ (0, g ) = y o s (0, g) for all q. Note that (u, g) = Y*{0, q) + Y<?(u, q), and 
hence we get that Y^(u, q) = Y^(u, q) for all q and u, which contradicts the 
observability of X. 

The statement for controllability grammian follows by duality. □ 
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Notice that an LSS may fail to be observable (resp. reachable), even if 
(JHD (resp. (ITU]) ) has a positive definite solution, see Example [T] of Section El 
This is due to the fact that in ([9]) and ffTUl) . we require inequalities instead 
of equalities. 

As we shall see in Section [61 a side effect of this phenomenon is that the 
reduced order model obtained by balanced truncation may fail to be minimal. 

As a consequence, one is tempted to ask the question what happens if 
in ([9]) (resp. in ( flUj) ). we require that for some or for all q G Q, A T Q + 
£A q + CjC q = (resp. VA T q + A q V + B q B T q = 0) holds with equality. In 
this case, the existence of a strictly positive definite solution to the equations 
will imply observability (resp. controllability) of some (or all) linear subsys- 
tems. However, in Remark El we have already explained that for a large class 
of input-output maps, including those which are realizable by quadratically 
stable LSSs, there exist no state-space representation such that the local 
linear subsystems are reachable or observable. Hence, by replacing inequali- 
ties by equalities we necessarily restrict applicability of the model reduction 
approach. 

5.1. Nice grammians 

As it was mentioned before, existence of a strictly positive definite con- 
trollability and observability grammian does not imply span-reachability and 
observability. In fact, there might exist many grammians, and it is not clear 
which one of them should be chosen. In discrete time, the problem above 
can partially be circumvented, by using what we will call nice grammians. 
Nice grammians are special cases of grammians which have the property that 
they are unique and their existence is equivalent to observability and con- 
trollability of the system. Their disadvantage is that they are not preserved 
by balanced truncation. However, they are potentially interesting for com- 
putational purposes and as canonical forms in system identification, and for 
this reason we discuss them here. 

For the formal definition, we introduce the following terminology. 

Definition 13 (Strong stability). We call the LSS £ strongly stable, if the 
matrix YlqeQ^q ® ^ s a stable matrix (all its eigenvalues lie inside the 
unit disc). 

From [32], we obtain the following result. 
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Lemma 7. Consider n x n matrices F q , qeQ. UYl l qeQFq®F q T ^ s a stable 
matrix, then the equation 

q&Q 

has a positive semi-definite solution P > for all positive semi-definite Q > 
0. In fact, this solution is unique and 

P=Y, FlQF w . 

w&Q* 

Conversely, if the inequality 

P-CE FqPFq) > 

has a positive definite solution, then YlqeQ Fq ® F q is a stable matrix. 



The proof of Lemma [7] can be found in Appendix H Just like quadratic 
stability, strong stability is preserved by minimization. 

Lemma 8. // E is strongly stable and S m is a minimal LSS which is equiv- 
alent to S ; then S m is strongly stable too. 



The proof of Lemma [8] can be found in Appendix I With the above 
discussion in mind, we define the concept of nice grammians. 

Definition 14. Assume that £ is strongly stable. Then the unique positive 
semi-definite solutions V and J3 to 



3 T 

q 

qeQ qeQ 

qeQ qeQ 



are called nice controllability and nice observability grammians, respectively. 

Notice that A q VA T q + B q B T q < Y.«eQ A ° VA l + B ° B l and A l^ A l + 
C q C q < ^2 a& q A^jSAv + CjC a . Hence, nice grammians are indeed grammi- 
ans, since they satisfy ffHJj) and §§§ respectively. 
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Lemma 9. If £ is strongly stable, then the nice controllability and observ- 
ability grammians exists and they are unique. 



The proof of Lemma can be found in Appendix J 



Lemma 10. E is span-reachable if and only if the nice controllability gram- 
mian V is strictly positive definite. £ is observable if and only if the nice 
observability grammian is strictly positive definite. 

Proof of Lemma Q7J We prove the statement about observability, its coun- 
terpart on span-reachability follows by duality. From Lemma [7J it follows 
that 

x ^■x — ^ x J\. v C C A v x — ^ "j 1 1 C -A. v X\\o 

v&Q* vgQ* 

where C = [Cf , . . . , C^] T . Then it follows that x T J2x = is equivalent 
to C q A v x = for all q G Q, v G Q*. By Remark @] the latter is equivalent 
to x G ker(9(S). From this the statement of the lemma follows by using 
Theorem |2] and Remark HJ □ 

To sum up, if E is a strongly stable system, then the minimization pro- 
cedure Procedure [3] preserves strong stability Moreover, if E and E are two 
isomorphic systems related by an isomorphism S from E to E, and if V and 
J2 are the nice grammians of E, then SVS T and J2,S~ X are the nice 
controllability and observability grammians of E. In other words, the sin- 
gular values of V£l are independent of the choice of the particular minimal 
realization, and existence of strictly positive definite nice observability and 
controllability grammians is guaranteed in minimal systems. 

5.2. Singular values 

We present the interpretation of the largest singular value of a grammian 
pair (V, =2) in terms of the Hankel-norm of the input-output map. 

Definition 15 (Hankel-norm). Let E be a quadratically stable LSS and define 
the Hankel-norm ||F S ||// as follows. Denote bylA the set of all inputs u 6W 
such that there exists a time instant t (t G T in continuous-time, t G N for 
discrete time), such that u(s) = for all s > t. Let HG(E) be the set of all 
7 > such that 

VueU ,qeQ:\\Y s (u,q)\\ 2 < 7 \\u\\ 2 , 
Define the Hankel-norm ||Y S ||# ofY^ as WY^Wh = inf HG(E). 
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Remark 7. IfE is quadratically stable, then by Lemma{^ y s has a finite C 2 
norm and the L 2 (or in discrete-time case 1%) norm ||Y E (M,g)|| 2 exists and 
it is finite. From the definition o/||y E ||£ 2 it follows that ||Y E ||,c 2 G HG(S) 
and hence ||Y s ||fl- < ||Y S ||£ 2 . 

Intuitively, the Hankel-norm of Y s corresponds to the maximum output 
energy of the system, if we first feed in a continuous input u with unit energy 
and from some time t we stop feeding in continuous input and we let the 
system to develop autonomously. 

Theorem 5. Consider an LSS S. Assume that V > is a controllability 
grammian and JS > is an observability grammian o/E. The largest singular 
value a max of {V, =2) satisfies 

I I II rr 

Proof of Theorem^ Pick a switching signal and input (q, u) G Q x U such 
that for some time instance t that u(s) = for all s > t and \\u\\2 < 1. 
Denote by x and y the corresponding state and output trajectories. Note 
that by Lemma [21 y belongs to L 2 (T,Y) (cont. time) or hiX) (disc, time) 
and hence the norm \\yW2 exists and it is finite. By combining Lemma and 
Lemma El we obtain that x^t^V'^-x^t) < 1 and 

x T (t)£x(t) > \\y\\l 

Since u, q and t are arbitrary, we then obtain that 

sup x T £x > ||y s ||| 

x T V- 1 x<l 

We proceed to prove that 

Xmax(P£?) = SUp X T £2X 

x T r~ 1 x<i 

Let V- 1 = S T S, and define J = (S- l ) T BS-\ It follows that 
{Sx I x T V~ l x < 1} = {v I v T v < 1}. 

Hence, 

sup x 1 J3x = sup v T J3v = A max (^), 

x T T- 1 x<l v T v<l 

where X ma x(Q) is the maximal eigenvalue of J2. But £! = SVJ2S~ 1 , hence 
the eigenvalues of and VJ2 coincide. □ 
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For nice grammians V and J2, the sum of their singular values can be 
represented as a Frobenius norm of the Hankel-matrix of the system. In 
order to present this result, we will first recall the notion of a Hankel-matrix 
for linear switched systems. Although Hankel-matrices can be defined both 
for continuous- and discrete-time, we will below concentrate on the discrete- 
time case only. Consider a LSS S = (n, Q, {(A , B , C ) \ q £ Q}) and 

for any v £ Q*, define the Markov-parameter M v = CA V B, where C = 
[Cf, . . . , C£] T and B = [Bf, B D ] . In [26] it was shown that the 

definition of the Markov-parameter depends only on the input-output map 
y s and not on the choice of £ itself. Define then the Hankel-matrix of F s 
as the infinite block matrix 

rows and columns of which are indexed by sequences from Q* such that H 8fV = 
M vs . Using the notation above, we can relate tr(V£?) and the Frobenius- 
norm of H as follows. 

Lemma 11. IfV and £} are the nice grammians o/£, then 

tr(V£) = J2 W H s,v\\ 2 f, 

v,s£Q* 

where \\.\\f denotes the Frobenius norm of a matrix. 
Proof of Lemma [771 Notice that 

£ = A T q 3A q + C T C and V = A <?K + BB T . 

From Lemma [7] it follows that 

£ = A T W C T CA W and V = ^ A V BB T A T V 

wGQ* v&Q* 

and hence, 

V£= Y. A "BB T A T V A T W C T CA W , 

w&Q* v&Q* 

and thus 

tr(V£>)= J2 tT ( A v BBTAT v A ™ CTCA ^- 
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Notice now that 

ti((A v B)(B T A T v A T w C T )(CA w )) 

= ti{B T A T v A T w C T ){CA w A v B) 
= tv(H wv H WiV ) 
— II w ll 2 

□ 

If V — £1 — diag(a 1 , . . . ,o~ n ), then tx(V J2) = ^YTi=\°1 an d hence the 
lemma above implies that this quantity does not depend on the state-space 
representation. 

6. Model reduction for linear switched systems 

In this section, we state the procedure for model reduction by balanced 
truncation, and we prove a bound of the approximation error. 

Procedure 4. Balanced truncation Consider a LSSJ^ = (n,Q, {(A q , B q , C ) 

<r (>})■ 

1 . Find a positive definite solution J2 > to ([9]) . 

2. Find a positive definite solution V > to ( TTOT) . 

3. Find U such that V = UU T and find an orthogonal K such that 
U T J2U = KA 2 K T , where A is diagonal with the diagonal elements 
taken in decreasing order. Define the transformation 

S = k l ' 2 K T U- 1 

4- Replace £ with 

Sbai = (n, Q, (A q = SAgS^ 1 , B q = SB q , C q = C q S~ 1 ) qG Q). 

5. The transformed system Eb a i is balanced, i.e., Wq € Q : 0(g,Eb a i, A) < 
Vg G Q : C(g,Sbai,A) < 0. Indeed, it is enough to notice that A = 
(5~ 1 ) T £HS~ X = SVS T and use these expressions to derive 0(q, Ebai, A) < 
and C(q, S bal , A) < from 0(g, E, &) < and C{q, S, V) < for all 
qeQ. 
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6. Assume that A = diag(o"i, . . . , a n ), o~\ > a 2 > • ■ ■ > a n . Choose r < n 



and let Ai = diag(cri, . . . , o~ r ). Choose A q G 



and 



C q G W xr so that 



A„ 



A q A qA2 
Aj,21 A q2 2 



B„ 



B n 



9.2. 



a 



T 



■ q,2. 



(14) 



Return as a reduced order model E = (r, Q, {(A q , B q , C q ) \ q G Q})- 

In the following, we will state an error bound for the difference between 
the input-output maps of E and S. To this end, we will use the following 
simple fact, due to [If in the continuous case. 

Lemma 12. The LSS E returned by Procedure^is balanced. In addition, if 
either Vq G Q : O(g,£,«0) < or Vg G Q : C(g,E,7 3 ) < 0, then E a/so 
quadratically stable. 

Proof of Lemma [TM The first statement of the proof follows by showing that 
Vg G Q : 0(g, E,Ax) < and Wq e Q : C(g,E,Ai) < 0. For the continous- 
time case the proof of this claim is straightforward: 



A q A 



AgA 



A q A x * 



k 



A q Ai k 



Lq* 



and hence for K G {C, O}, 

K(g,E,A) 



K(g,E,A 1 ) * 



Hence, if K(g, E, A) < 0, then K(g, E, Ax) < 0. 

For the discrete-time case, using the notation of Procedure HI it is easy 
"Ai 



to see that if A 



A 2 



where Ai G 



r xr , then 



A q AA q 



A q AA q 



A q A 1 A q + A qA2 A 2 A : 



9,12' 



A T q A 1 A q + A T n2 ,A 2 A q ^, * 



x <7 1 ^q,2V 
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Hence, the corresponding inequalities for the balanced system £ can be writ- 
ten as 



> A n AAi 



B q B T q - A 



A ? A 1 ij , + A 9jl2 A 2 Aj 12 + 4^-Ai, *' 



0>A q AA q + C q C J q - A 

iTAii, + A T a2 ,A 2 A„ 21 + CjCj - Ai, * 



Thus, we get that 



A q ^A T q + B q B T q - Ai 



< i g Axi[ + A,, 12 A 2 Aj; i2 + B q B T q - Ax < 
ijA x i g + C T q C q - Ai 

< i^Axi, + Al 21 A 2 A qi 2i + - Ai < 

from which it follows that Ai is both a controllability and observability gram- 
mian. 

The proof above also yields that if Vg G Q : 0(q, X,=2) < or Vg G 
Q : C(q,E,V) < 0, then Vg G Q : 0(g,S,Ai) < or respectively Vg G 
Q : C(g, S,Ai) < 0. By Lemma [1] the latter implies that X is quadratically 
stable. □ 

Remark 8 (Nice observability/controllability grammian). In the discrete- 
time case, one could take the nice observability and controllability gram- 
mians from Definition T% as inputs for Procedure \^ It is clear that the 
balancing step then leads to a nice controllability and observability grammi- 
ans which are diagonal and equal to each other. However, from the proof 
of Lemma [23 it is clear that the resulting reduced order system might be 
balanced, but the grammian Aj of the reduced system is not necessarily the 
nice grammian. However, from the proof of Lemma [23 it follows that Ai 
is the nice observability and controllability grammian of the system X = 



-,Q,{(A q , [B q , A qA2 ] 



a, 



A 



9,21. 



q G Q})- It remains a topic of future 



research to find out if the balanced truncation procedure can be adapted in 
such a way that Ai remains a nice grammian. 
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One may wonder if the system S returned by Procedure H] is minimal, 
at least when S was minimal. The answer is negative, as demonstrated by 
Example [H The fact that the reduced system need not even be minimal 
already indicates that Procedure H] might be too conservative. 



Example 1. Assume Q = {1} consists of one element, A 



-2 











-1 


1 








-3 



B 



C — [l 1 0] . Then (A, B,C) is balanced according to our 



'-2 " 




1 


, B = 


-1 






definition with A = diag(2, 1, 0.5). However, A 
C — [l l] , which is clearly not minimal. 

Theorem 6 (Error bound). For the system S returned by Procedure^ 



and 



\c 2 



< 



2 £ 

k=r+l 



0~k- 



(15) 



Proof of Theorem^ The proof of TheoremEUs based in the following lemma 



whose proof is in Appendix K 



Lemma 13. For r = n — 1, ffT51) is true. 

Suppose that Si is the reduced system obtained by removing the singular 
value o~ n . It is easy to see that Si is again balanced with grammian Ai. We 
can again apply the model reduction procedure to Si, remove its smallest 
singular value <r n _i and obtain S 2 . Suppose that the balanced system Sj 
with grammian Aj = diag(a"i, . . . , a n _j) is given. Define S i+1 as the system 
which is obtained from S« by applying the balanced truncation to the last 
state, i.e., to the state which corresponds to a n -i- In this way, we obtain 
systems Si, . . . , S n _ r such that dimSj = n — i and \\Y^ X — Yp\\ C2 < 2a n - i+ i, 
where S = S. Notice that S n _ r = S 



< 



n—r 

E 

4 = 1 



|Sj_i — Sj| \c 2 < 2 a/,, 

fc=r+l 



i.e., the error bound holds. 



□ 
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Remark 9. Theorem and the second statement of Theorem [3] imply that 
it is enough to apply balanced truncation to minimal LSSs. Indeed, let us 
apply balanced truncation to an LSS £ with controllability and observability 
grammians (V,J2). Assume that o~i > . . . > o n are the singular values 
of (V,J2), n = dimS. Then the approximation error will be bounded by 
2 Y^H= r +i a i- If we replace (V,J2) by the correspondig grammians (V m , J2 m ) 
of a minimal LSS £ m , as described in Theorem^, and we perform a balanced 
truncation by keeping the first r singular values, then the error bound becomes 
2 Yli= r +i < 2 XliLr+i <7 i' the error bound obtained by using the minimal 
LSS does not exceed that of for the original system. 



7. Relationship with Other Work 

Results similar to those presented in this paper have already been ob- 
tained by 0, 17, 15]. More precisely, ^ studies the model reduction of a 



linear parameter varying system, 

LPV ■ f*® = Aq{t)X ^ + S <z(*) u (*)' = x ° ( 16 ) 
\y(t) = C q{ t)x{t), 

where q is a continuous function T — > B C M. s , B = [p^Pi] X . . . x [p s ,pj] for 
some p. <Pi, and A q ,B q , C q are assumed to be continuous functions of q. In 
the following, we will refer to the system ( JT6j) as LPV. 
The L2 norm of the LPV system is 

\\Y LPV \\ L2 = sup sup \\Y LPV (u,q)\\ 2 . 

qeC(T,B) \\u\\ 2 =l 

Furthermore, j^] uses similar LMI characterization of the L 2 norm. Specifi- 
cally, if \\Y LPV \\ l 2 < 7 then there exists a solution P > to 

\lqeB : G 7 (g,LPV,P) < 0. 

The controllability and observability grammians in [i[ are solutions Q and 
V to 0(q, LPV, Q) < and C(q, LPV, V) < for all q e B. Hence, they are 
also similar to the continuous-time grammians used in this paper. 

Despite apparent similarity between the LPV and LSS formulations, the 
two systems are not compatible as q signal in ( !T6l) is assumed to be a contin- 
uous function. Hence, the results of [3| are not directly applicable to linear 
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switched systems. Nonetheless, the proof of the error bounds in [i| does not 
use the continuity of the signal q nor the continuous dependence of A q ,B q , C q 
on q; hence, the proof technique can be adapted to the switched case. As a 
result, the error bounds for the balanced truncation provided in [i| are sim- 
ilar to (I15p. Note however, that the style of the proof of Theorem [6] is closer 



to that of |18| than to [3j. Moreover, counterparts of Theorem H] and Theo- 
rem and Lemma 0, Lemma M can be found in ^ . While 0] did state that 
their model reduction procedure and the estimate of L<i norm do not change 
under a state-space isomorphism, the analysis in [3] does not conclude that 
the existence of LMI estimates of the L 2 norms, or indeed the existence and 
singular values of the grammians is independent of the choice of state-space 
realizations. In fact, the latter would be difficult, since there seem to be no 
realization theory for the type of LPV systems which is considered in [jjj]. 
Note that realization theory of certain classes of LPV systems was developed 
by H- 

In 17], model reduction of uncertain discrete-time systems was inves- 
tigated. A structured uncertain system was viewed as a Linear Fractional 
Transformation (LFT), 

M ★ A = D + CA(J - AA)~ 1 B, 

/ 2 (N, R n ) — > Z 2 (N,R n ) represents the uncertainty, and M = 

The norm of the system M is the supremum of the norms of 



where A 



" A 


B ' 


C 


D 



G * A, where A is any element of a bounded set of structured disturbances. 

The model reduction procedure presented in 17J and the corresponding 
error bounds are similar to the ones presented here for discrete-time linear 
switched systems. The main steps of the proofs are also similar. Nonetheless, 
the precise relationship between the results of 17] and the ones presented 
above is not yet clear. In an attempt to clarify this connection, we represent 
a linear switched system as a structured uncertain system as follows. 

Let the structured uncertain system associated with a discrete-time switched 
system £ = (n, Q, {(A B C)\qe Q}) be 



My 



" A 


B ' 


C 


D 



' 


A x . 


. A D 


Bi . 


• B D ' 


/ 


. 


. 


. 


. 


I 


. 


. 


. 


. 





Ci . 


. c D 


. 


. 



32 



We fix an infinite switching sequence v = q$qi ■ ■ ■ G Q. For a k G N, we 
define the operators d v : l 2 (N,R k ) -> / 2 (N,IR fc ) as follows 



<{z){t) 



z(t)X{r\ qr =q}{t - 1) tft>0 

if t = 0. 



where X{T|g T = g } is the characteristic function of the set {r G N| q T = q}. Let 
8- 1 : l 2 (N,R n ) ->• ^ 2 (N,M n ), = fort > 1 and <y _1 («)(0) = 0, 

be the backward shift operator. By abuse of notation, we will apply the 
operators d v q and 5~ to signals in Euclidean spaces of different dimensions 
without specifying the dimension. 

We define the uncertainty structure 

A" = diag(<T\ </?,...,<&). 

For an inputs u G Z 2 (N, M m ), define w q = w g (u) = dg(<5 _1 (w)) and let 
x = (xo, xi, . . .) be the state trajectory of £ which corresponds to the inputs 
u and switching sequence v. If £ is quadratically stable, then by Lemma [2] 



x G U 



Define z n 



With this notation, 



x 



ZD 



Z2 




' AA V 


B ' 






CA V 






X 
Zl 
Z2 

Zp 



where A,B,C are the corresponding sub-matrices of Ms. As a consequence, 
5~ 1 {y) = (M E * A v )w with w = w(u) 



T\T 



We notice that the induced / 2 operator norm of A v is 1 for any « 6 Q; 

13, A" G B A with 



hence, following the notion of 

B A = {A : / 2 (N,M n(D+1) ) ->• l 2 (N,R n(D+1) 



|A|| < !}• 



Furthermore, / 2 -norm of w 



wd) equals the l 2 norm of 5 1 (u). In 



17} , the norm 1 1 Ms 1 1 of Ms is defined as follows 
1 1^1 1 



sup sup 1 1 (Ms * A)w || 2 . 

AeB A w£l 2 (N,R mD ),\\w\\2=l 
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We claim that WY^W^ < ||M S ||. Indeed, from S~ 1 (y) = (M s ★ A v )w(u), 
it follows that 1 1 ^ 1 (2/) 1 1 2 < ||M S || • \\w(u)\\ 2 . Since ||w(u)|| 2 = | |<y _1 (w)|| 2 , it 
then follows that 1 1 <5 1 (2/) 1 1 2 < ||Ms|| ■ 1 1 <5 1 (^) 1 1 2 But 5~ 1 (y) is the response 
of E to the input <5~ X (V) and the switching signal <5 -1 (t>). Since the range of 
all possible choices of and covers the whole space U x Q, we 

get that 

V(«,g)G«x Q : \\Y*(u)\\ 2 < ||M S |||H| 2 

which implies that ||^ E ||,c 2 < ||Ms||. 

Below, we state what we know about the relationship between the model 



reduction procedure of this paper and that of [17 



Lemma 14. Let £ be a discrete-time LSS, and let Ms be the associated 
structured uncertain system. Then the following holds. 

1. If My, is stable according to the terminology of [17], then £ is strongly 
stable. 

2. The LSS £ is minimal if and only if M s is minimal according to the 



terminology of 117] 



3. Assume that the block- diagonal matrix V = diag(Pi, . . . , Pd+i), < 
p. e E nxn • = i 5 ... )jD + i ( resp . g = diag(Q 1 ,...,Q D+1 ) < 
Qi G M nxn ; i — 1, . . . , D + 1) is a controllability fresp. observability) 
grammian of Ms according to the terminology of ll 7r\. 

Then the following holds. 

(a) Pi (resp. Qi) is a controllability (resp. observability) grammian 
of E, and 

Y J {A q PiA T q +B q B T q )-Pi<^ 

2 (17) 
Y,{A T q Q x A q + C T q C q ) - Qi < 0. 

q&Q 

(b) If My, is balanced, i.e., V = £1 is diagonal, then £ is balanced. 



2 Note that according to [17| . controllability and observability grammians are by defi- 
nition block-diagonal 
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(c) If M-£ is balanced and E is the result of applying Procedure \4\ with 



the grammians Pi 
truncation to Ms. 



Qx, then Mj is a result of applying balanced 



The proof _of Lemma [H] is presented in |Appendix L| One is tempted 
for model reduction of LSSs. However, this leads to the 



to try to use [17 



following challenges. 



In order to apply the methods of [17j, Ms has to be stable. By Lemma 
HJ stability of Ms implies strong stability of E. Note that strong 
stability is a more restrictive property than quadratic stability. Hence, 
the scope of applicability of [17J appears to be smaller than that of the 
current paper. 



Even if Ms is stable, we face restrictions. While by Lemma [TH gram- 
mians of Ms yield grammians of E, it is not clear that the converse 
holds. Hence, the error bound obtained by using 17] might be more 
conservative. 

Let M be the result of balanced truncation applied to Ms. as described 
Then M is a structured uncertain system, but it is not clear 



m 



17 



how to convert the M to an LSS. In fact, even balancing might destroy 
the very specific structure of Ms and hence make it difficult to interpret 
the balanced version of Ms as an LSS. 

Finally, while for balanced Ms, the results of Procedure H] and the 
procedure from 17j are comparable, it is not very clear how these two 
procedures are related in the general case. 



Despite the difficulties mentioned above, exploring the relationship with [17 
remains worthwhile. In particular, the results of Lemma [H] indicate that 
the relationship might be much closer than it appears at the first sight. In- 
tuitively, it is also clear why 17j seems to yield more conservative results: 
the behavior of an LSS corresponds to a subset of behaviors of a structured 
uncertain system. Hence, the model reduction procedure of [l7j has to pre- 
serve a much richer behavior than the one presented in this paper. To sum 
up, despite numerous similarities, it is unclear if [17] can be used for model 
reduction of LSSs. 

Concerning the work of Jl5j, the main difference is that we consider de- 
terministic systems, while [15J considers stochastic systems with switching 
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modeled as a Markov process on Q. The nice grammians of the present pa- 
per correspond to the grammians of [lij], if we associate with the discrete-time 
deterministic S the following stochastic system 




where 9{t) G Q is an identically distributed independent process, u{t) is 
deterministic, x = 0, and p = P(0(t) = q) > for all q E Q. In |15| . the 
norm of the system is smaller than 7 if Ylt^o E[\\y(t) | | 2 ] < 7 2 1 \u\ \\. To ensure 
that the system norm is finite, the stochastic systems at hand are assumed to 
be mean-square stable and only inputs u G /2(N,lR m ) are considered. With 
the correspondence above, the balancing procedure in our work becomes 
similar to that of [l5j. This is summarized in the following lemma. 

Lemma 15. Consider the discrete-time LSS £ and let E st be the associated 
stochastic system. Then the following holds. 

1. 7/E is strongly stable if and only «/S st is mean-square stable according 

to EI 



2. V (resp. B) is a controllability (resp. observability) grammian of S s t 
according to the terminology of tla] if and only if 

Y,{A q VA T q +B q B T q )-V<U 

S (18) 
+ C T q C q ) -J2<0. 

In particular, controllability and observability grammians of S st are 
controllability and observability grammians o/S. Conversely, nice con- 
trollability and nice observability grammians o/S are controllability and 
observability grammians o/S st . 



3. The balanced reduction algorithm presented in [15] coincides with Pro- 
cedure [7} if the latter is applied to grammians of (I15p . 

4. If the norm of H st is 7 according to \l5\] , then ||^ s ||/ 2 < 7. 
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The proof of Lemma [TB] is presented in Appendix M From Lemma [T51 
it follows that the error bound for the balanced truncation in ( 1151) follows 



m 



from the error bound derived in 15 , if one uses nice grammians. However, 
15| the questions related to minimality and dependence of the grammi- 



ans on state-space realization were not discussed. Note that the results [15 
are directly applicable only to strongly stable linear switched systems, while 
the results of the current paper are formulated for quadratically stable LSSs. 
Furthermore, note that 15] is applicable only to a subset of grammians. For 
this reason, the model reduction procedure from 15j, when applied to deter- 
ministic LSSs via the embedding above, is likely to yield a more conservative 
error bound. This is not suprising, since [15[ addresses model reduction of 
stochastic systems, of which deterministic systems form a subclass. 
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Appendix A. Technical proofs 



For some of the proofs below we will need the following simple conse- 
quence of using Schur complements. 

Lemma 16. Let A, P G R nxn , S G R kxn , P > 0. Let e G {<, <} Then the 
following holds. 

1. A T P + PA + S T S eO, ifandonlyifAP- l + p- l A T + p- l S T SP~ l eO, 
or, equivalently 

'P- 1 A T + AP- 1 P' 1 ^ 1 

sp- 1 -I 



eO. 



2. -P + A 1 PA + S 1 S e 0, if and only if 

-P- l +AP~ l A T -AP- l S T 
-SAP- 1 -I + SP^S 7 



e 0. 



Proof of Lemma [73 The first statement follows by multiplying A T P + PA + 
S T S by p- 1 from left and right and noticing that since P _1 is symmetric, 
A T P + PA + S T Se0 is equivalent to P~ 1 {A T P + PA + S T S)P~ 1 e0. By 
taking Schur complements, it follows that AP^ 1 + P~ 1 A T + P~~ 1 S T SP~ 1 e 
is equivalent to 

'p- i a t + ap- 1 p-'sn 

sp- 1 -i e u - 
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In order to prove the second statement, the discrete case, notice that 
-P + A T PA + S T S e is equivalent to 



-(P- 



~A 


T 


P 0" 




A 


S 




.0 I k 




s 



e 0. 



Using Schur complements again, the latter is equivalent to 

~P A T S T ~ 



A P- 1 
S h 



€ 



h+n 
In 

from left, we get the following equivalent LMI 



Multiplying the latter inequality by S 



from right and by S 7 



P" 1 A 
4 S 
A T S T P 



e 0. 



By using Schur complement again, from this we obtain that the latter LMI 
is equivalent to 



-P-i + AP-M 7 -AP- l S T ' 
-SP- l A T -I k + SP- l S T 



e 0. 



□ 



Appendix B. 

Proof of LemmaUl (ii) implies (i) It is clear that if Vg G Q : 0(q, S, ££) < 
0, then Vge Q : S(g,S,^) < 0. 

(iii) implies (i) If Wq G Q : C(q, E, P) < 0, then by taking A = A T q and 
S = B g P,T, it follows from Lemma M that Vg G Q : S(g, S,p- X ) < 0. 

(i) implies (ii) and (iii). We present the proof separately for the 
discrete-time and for the continuous-time case. 

Continuous-time: Assume that for some P > 0, Vg G Q : A T q P + 
PA q < 0. Then for any q G Q, the exists a scalar j q > such that Aj P + 
PA q + 7gM g < 0. Take M g = C^C q and let 7 = min{7 9 | q G Q}. Then 
A^P + PA q + 7 M 9 < 0. Define S = ±P. Then 

Vg G g : A^S + 5A g + M q < 0. 
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By choosing M to be C q C q and £} = S, we obtain a solution to dSJ). If we 
choose M q = PB q BjP, then using the fact that S = ^P and Lemma UB\ we 
get that 

Vg E Q : A^ 1 + S^A* + B^JV < 0. 

By choosing V = -^iS -1 = -P^ 1 and using Schur complements, we get that 
flED holds. 

Discrete-time: If P > is such that P — A T PA q > 0, then for any 
M q > 0, there exists 7 g > such that P — A^PA q — 7 g M g > 0. In particular, 
by taking 7 = min{7 g | q E Q}, P - A^PA q — jM q > 0, or, in other words 

Vq E Q : AqSA q + M q - S < 0, 

where S = -P. If we choose M q = C q C q and set £} = S, then we get that (J9]) 
holds. From the second part of Lemma [161 it follows that if P — A T q PA q > 0, 
then P^ 1 — A q P~ 1 A q " > 0. By interchanging A q and A T q and using P^ 1 
instead of P, we can repeat the argument above. We thus get that for any 
M q > 0, there exists V > such that 

Vg E Q : A q VAq + M q - V < 0. 

By taking M q = B q B T q ', it follows that ([TO]) holds. □ 

Appendix C. 

Proof of Lemma In continuous-time, the proof that existence of a solution 
P > to ([ED implies that ||^ s ||,c 2 exists and ||l" E ||,c 2 < 7 follows from [20I . 
Theorem 1] by taking V(x) = x T Px. A similar argument can be done for 
the discrete-time case. 

In order to be self-contained, we present an elementary proof of the im- 
plication 

VgeQ:G 7 (g,P,S)<0 \\Y*\\ C2 < ^ 

both for the continuous- and discrete-time case. 

Fix an input and switching signal (u,q) EU x Q and denote by x and y 
the corresponding state and output trajectory of E. We have to show that 
for u EU, the output y belongs to L 2 (T, R p ) for continuous-time case and to 
/ 2 (N, 1R P ) for the discrete-time case. 
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Notice that if we define 



lim^oo f* \\y(s)\\lds cont. 
lim^oo Yf s =o \\y( s )\\2ds disc. 



2/ 2 



then | \y\ \ 2 is well-defined (possibly equal +00) and y belongs to the L 2 (T, 
(resp. Z2(N,R P )) if and only if \\yW2 < +00. In the latter case, \\yW2 is 
just the standard L 2 and l 2 norm respectively. Hence, it is enough to show 
IMI2 — 7 2 || u ll!> ^ we use the extended definition of \\y\\% described above. 
Assume P is a solution to ( IT2|) . Define 

A(x T (t)Px(t)) 

f t (x T {t)Px{t)) (cont.) 
x T {t + l)Px{t + 1) - x T (t)Px(t) (disc.) 

Then a simple calculation reveals that both for continuous and discrete-time 
cases, 



A(x T (t)Px(t)) 



x(t) 
u(t) 



1 T 



G 7 (g(t),P,E) 



x(tj 
u(t) 



+ i A \Ht)\\i-x(tyc^ t) c q{t) x(t) 
<i 2 \W)\\ 2 -\W)\\ 2 

Notice that for continuous-time systems 

A(x T (s)Px(s)) = x T (t)Px(t) - x T (0)Px(0) 

= x T (t)Px(t). 
Similarly, for the discrete-time systems, 

^A{x T {s)Px{s)) = x T (t)Px(t) - x T (0)Px(0) 



s=0 



x 1 (t)Px(t). 



In both cases, we used the fact that x(0) = (see page [9]). Recall that for 
continuous-time case 



MI2 



00 ft 
u(s)\\lds > 

'0 



\u(s)\\ods. 
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Similarly, for the discrete-time case, 

oo 

= £ M*)\\l >£>(*) 



in 



\l 



s=0 s=0 

Hence, by taking integral in the continuous-time case and sums in the discrete- 
time case, we obtain 



x T {t)Px{t) < j 2 \\u 



f*\\y(s)\\ 2 2 ds (cont.) 

Etiusm (disc.) 



Since P > 0, x T (t)Px(t) > and thus the inequality above yields 



So \\y( s )\\l ds ( cont 

£1=0 I If 00 1 12 (disc.) 



< 



7 1Mb- 



By taking limit of the left-hand side as t — > oo, it follows that \ \y\\\ < T 2 1 1 1 1 i - 
If E is quadratically stable, then by Lemma (U there exists V > such 
that Vg e Q : C(g, E,P) < 0. By taking A = A^, S = in Lemma [HI it 
then follows that for all g 6 Q, 



Gi(g,E,P 



c g T c g 0' 





< 0. 



Since C q C q > 0, it then follows that there exists a large enough 7 > such 
that 

G 1 (g,E,p- 1 ) + (l-l) 

T 

Notice now that 



c T q c q 





< 0. 



(C.l) 



7 2 G 1 (g, E, V- 1 ) = G 7 (g, E, fp- 1 ) + ( 7 2 - 1) 



c T q c q 





By multiplying (IC.ip with 7 2 and using the equality above, 



0>G 7 (g,E, 7 i p- 1 ) + ( 7 2 -l 



C T q C q 




+ (1-7 Z 
= G 7 (g,E, 7 2 p- 1 
Hence, 7 2 P~ 1 satisfies (112]). 



C T q C q 




□ 
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Appendix D. 



Proof of Lemma [3J In the proof we will used the notation (J7J) of Procedure 
[TJ The lemma follows from the following observations. 
Observation 1 



Observation 2 



A T q PA q 



(Af) T P ll + P n AX * 



(A«) T Pn * 



Af A- 

. o a\ 



{A*) T P U A* * 



Observation 3 



Observation 4 



Observation 5 



CqC q 



PB„ 



B T q PB q 



(Cf) T Cf * 
-k -k 



PnB q 



:b?) t p 11 b?. 



■q I - xx — q 

If K = S, then Observation 1 implies the statement of the lemma for 
the continuous-time case and Observation 2 implies the statement of the 
lemma for discrete-time case. 

Finally, by combining Observation 3, Observation 1 and Observa- 
tion 4, it follows that for continuous time 



G 7 (g,£,P) 

-(Af) T P n + P n Af+(C?) T C? * P n Bf 



[B*) T Pn 



-k 



-1 2 I 



(D.l) 



It is easy to see that G 7 (g, S, P) < implies that 



XAffPn + P n Af + {Cf) T Cf P U B* 
{B*) T P n - 7 2 /. 



< 0, 
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and the latter is equivalent to G 7 (g, E^, Pn) < 0. By combining Obser- 
vation 3, Observation 2 and Observation 5 for discrete-time case, we 
obtain that 



G 7 (g,£,P) 



XA*) T PnA*+{C*) T Cf * (A?) T PRB, 



q ) ii q 1 \~q ) ~q 



A*PuB* 



q I - 11— q 

* BfP^Bff-fl 



(D.2) 



Hence, by a similar argument as for the continuous-time case, G 7 (g, E, P) 
< implies G 7 (g, E r , Pn) < 0. 

By combining Observation 3, Observation 2, and Observation 1, it 
follows that 

0(g,£ r ,P u ) * 



0(g,E,P) 



and hence 0(g, E, P) < implies 0(g, E r , Pn) < 0. 

Finally, we will show that if Vg G g : C(g, E, P _1 ) < 0, then Vg G g : 
C(g, E r , P^ 1 ) < 0. From Lemma El it follows that Vg G Q : C(g, E r , P" 1 ) < 
if and only if Vg G Q : Gi(g,E,P) - C T q C q < 0. From Observation 3 
and flTXll - flTX2D it follows that Vg G Q : Gi(g, E, P) - CjC^ < implies 

ii ^TfjR <- g p rom Lemma [TBI it then follows 



Vg G g : G^E^Pn) - (C q , . ,, 
that C(g, E r , P n x ) < for all g G Q. 



□ 



Appendix E. 

Proof Lemma H The first part of the statement follows directly from Lemma 
[T6l by taking S = 0. The second statement follows by noticing that P G 
O(E) ^ P G C(E T ) and P G C(E) P G 0(E T ). The third 

statement can be seen as follows. For the continuous-time case, notice that 
P G G 7 (E) is equivalent to 

Vg G Q : A T q P + PA q + CfC, + ^PB q B T q P < 0. (E.l) 

By applying Lemma d6] to (IE. lj) it then follows that ( IE. II) is equivalent to 

Vg G Q : P" 1 ^ + A q p- 1 + p- l C T q C q P- 1 + ^P 9 Pj < 0. (E.2) 
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If we multiply (IE.2|) by 7 2 , we immediately get that R = 7 2 P 1 satisfies 
MqeQ : A g R + RA T q + B q B T q + ^RCjC q R, 



and the latter is equivalent to R e G 7 (E T ). 

For the discrete-time case, notice that P G G 7 (E) is equivalent to 



VgeQ: 



~ ^2-^ + Ag^PAq + ^CgCg A^^PB, 



(A*±PB q ) 
From (1E.3j) it follows that 



Bg^sPBg - I 



< 



\/q E Q : P — A T q PA q > 



(E.3) 



(E.4) 



where 



A, 



' Aq B~ 




~\P o" 


~Cq 


and P = 




J 



Applying the discrete-time part of Lemma [TBI with S = 0, P = P and A = A q , 
we get that flE.4j) is equivalent to 

MqeQ-.P- 1 - A q p- l A T q > 0. (E.5) 

Using the definition of A q and the fact that P -1 = diag(7 2 P _1 , 1), it follows 
that (1E.5|) is equivalent to 



VgeQ: 



—R + AqRAq + BjBg ±A T q RC q ■ 

(jAg RC q ) T ^CqRCq - I 



<0, 



(E.6) 



where R = -y 2 P 1 . By multiplying (1E.6I) by diag(/ n , jl p ) from left and right, 
it follows that flR6l) is equivalent to 7 2 P -1 e G 7 (S T ). □ 

Appendix F. 

Proof of Lemma\B Fix a switching signal q & Q and denote by x(t) and 
the state trajectory of S such that x(0) = x and u — 0, i.e. x = A^(0,g) 
and y = V S (0> ?)■ Define 



A(x T (t)^x(t)) 



(cont.) 

x T {t + l)«2a;(t + 1) - x T {t)£x{t) (disc.) 
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and denote 

S(a<X\-i J % J * + J * A < (C ° nt ° 
W ' ' \A T q £A q (disc.) ' 

Then & satisfies G Q : S(q, B) < -C T q C q and 

A{x T {t)£x{t)) = x T (t)S(q(t),B)x(t). 
Hence, it follows that 

A(x T (t)£?x(t)) < -x T (t)C T q{t) C q(t) x(t) = -\\y(t)\\l (F.l) 

Notice that 

\E!=oA(^W^(*)) (disc.) 

and that x T (t)£?x(t) > and hence —x T J2x < x T (t)J2x(t) —x T £ix. By tak- 
ing integrals j* \ \y(s) \ \\ds in the continuous-time case and sums E!=o \ \v( s ) III 
in the discrete-time case, and using (IF.lj) it follows that 

-x T Bx< hlo\\y( s )W 2 2 ds ( cont -) 

~ \-ELolb(s)III (disc.) ' 

By multiplying the inequality above by —1 the statement of the lemma fol- 
lows. □ 



Appendix G. 

Proof of Lemma\(^ Denote by So the LSS Eo obtained from X by replacing 
C q , q G Q by zero matrices. For any input u G U and switching signal qQ, 
the state trajectory x(t) of S and S are the same, but the output trajectory 
yo of S is identically zero. By taking A = A^, S = B^, q G Q, from Lemma 
[TBI it follows that V~ x satisfies 

VgeQ:G 1 (g,p- 1 ,E )<0. 

Hence, from the proof of Lemma [2] (when applied to S instead of S) it 
follows that 

X T (t)V- l x(t) < |M|£-|ll/0||2=IM|2- 

□ 
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Appendix H. 

Proof of Lemma [?| One can easily see that the matrix A = ^2 gG g <g> F 



7®F? 

is in fact a matrix representation of the linear map Z : ~R nxn — > R nxn defined 
as 



Z(V) = Y FjVF q 



This result is obtained by identifying W lXn with M n , as it is done in [32 



Section 2.1]. As a consequence, the eigenvalues of Z and A coincide. Since the 



eigenvalues of Z are inside the unit circle, it follows from 32|, Proposition 2.6] 



that P = Z(P) + Q has a unique solution. Notice that using the terminology 



of [32j, page 17] Z is a Hermitian map and positive operator. Indeed, if V 
is symmetric, then so is Z(V) and if V is positive semi-definite, then so is 
Z(V). Hence, by |32[ Proposition 2.6] the solution of P = Z(P) + £ is positive 
semi-definite, and if Q > 0, then P is positive definite. Moreover, notice that 
Z fc (£) = J2weQ* \ w \=kFwGF w and hence by [32j, Proposition 2.6], the solution 

Conversely, assume that P — Y^qeo -^qFA q > for some P > 0. Consider 
an n x n matrix V such that V > 0. Define the map K(V) = 5^„ e Q AgVA^ 
and notice that using the coordinate representation of [32|, page 17], A T = 
12 q eQ F g ® P<j is the matrix representation of K. Since taking transposes pre- 
serves eigenvalues, it then follows that it is enough to show that A T is a stable 



matrix. If we can show that lim^oo K k (V) = 0, then by 32j, Proposition 2.5] 
it follows that A T is a stable matrix. In order to show linifc_>oo K k (V) = 0, 
we use a Lyapunov-like argument. That is, we define W(V) = ti(V T P) 
and we show that it behaves like a Lyapunov function. More precisely, de- 
note by V the set of all n x n positive semi-definite matrices. Notice that 
K : V — > V is a continuous map, if V is viewed as a metric space with the 
metric d(V 1 ,V 2 ) = \\Vi - V 2 \\ F = tr((V[ - V 2 ) T (Vi - V 2 )). Notice moreover 



that K(0) = 0. Hence, if W satisfies the properties below, then by [34 . 
Theorem 2.12] the dynamical system 14+i = K(Vjt) defined on V is globally 
asymptotically stable for the equilibrium point 0, i.e. lim^oo K k (V) = for 
any V G V. The properties W has to satisfy are the following. 

1. W : V -> R is continuous, > for any S £ V, 

2. H/(S) = iff S = 0, for all S G P, 
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3. W(K(S)) < W(S) for all S G V, S ^ 0, 

4. W is radially unbounded^!, more specifically 

lim W(S) = +oo. 

|[S||f-+oo 

The first two properties follow from the definition. To see W(K(V)) < 
W(V) for any V > 0, notice that Vs exists (V§ ) T = and that 

= ti(V T P) = tr(VP) = tr(V*PV*) 

n 

i=l 
n 

>££e^4PV^ 

i=l <?eQ 

= J>((H<)PA g H) 

= J>(A ? V<P) = ^tr((A ? V<) T P) = W(K(V)). 
<?eQ geQ 

In order to see that W is radially unbounded, notice that there exists m > 
such that P — ml > 0. Hence for any S > 0, 

= tr(S T P) = tr(SP) = tr(^P^) 
i=i 

n 

|2 



>mJ2^Se t = ti(V) = \\S*\ 



i=l 



Since the Frobenius norm is subadditive, it follows that \\S\\f < H^ 2 1| 2 and 
hence 

VS > : m\\S\\ F < W(S). (H.l) 
Hence, W(S) is radially unbounded, i.e., lim\\s\\->aoW(S) = +oo. □ 



3t 



Using the terminology of 3J|, this property implies that W is uniformly unbounded 



4 here V ? is the unique matrix such that V — {V 2 ) 2 ) 
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Appendix I. 



Proof of Lemma Notice that state-space isomorphism preserves strong sta- 
bility. Indeed, if Ex and E 2 are related by an isomorphism S and their 
corresponding matrices are A q and F g , q G Q, then F q = SAgS' 1 and 
hence, £ geQ if ® F g r = (5~ r (8 5- T )(E 9e Q< ® ^)(^ T ® S T ). That 

is, J^oeQ ® -^T anc ^ SogQ ^ ® are sminar matrices, and hence they 
have the same eigenvalues. 

Since all equivalent minimal realizations are isomorphic, it then follows 
that it is enough to show that if E is strongly stable, then the result of 
application of Procedure [3] is also strongly stable. Note that Procedure [3] is 
just the subsequent application of Procedure [Q or Procedure [2], hence it is 
enough to show that Procedures [T] - [2] preserve strong stability. Recall from 
Remark [6] the notion of the dual system E T and recall that if E is the result 
of applying Procedure [j] to E T , then E T is the result of applying Procedure [2J 
to E. Notice that the matrices of E T are A q , q G Q, and (J2 q eQ A i ® A i) T = 
J2 q eQ Aq"®A^ . Since taking transposes preserves eigenvalues, it then follows 
that an LSS is stable if and only if its dual system is stable. Hence, if we 
show that Procedure [T] preserves strong stability, then by a duality argument 
we get that Procedure [2J also preserves strong stability. 

Thus, it is left to show that Procedure [1] preserves strong stability. If 
E is strongly stable, then by Lemma [TJ there exists P > such that P — 
J2 q eQ AqPAg > 0. Consider the partitioning of the matrix A q described in 

c) 11 t> 12 b e a compatible partitioning of 

J/21 P 22j 

P, i.e., Pn is r x r. From Observation 1 in the proof of Lemma [3] it then 
follows that 



Procedure [T] to S, and let P 



P-Y. AT « PA o 

96Q 



Hence, P-J2 q eQ A q PA g > implies that Ai-E^q^) 1 ' p u A q > 0- From 
P > it follows that P n > 0. From Lemma it follows that E geQ (^) T <8> 
(A q ) T is stable, i.e., the result of applying Procedure [Q to E is strongly 
stable. □ 
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Appendix J. 



Proof of Lemma That nice observability grammian exists, it is unique and 
it is positive semi-definite follows from Lemma [7] by setting Q = J2 q eQ C q C q 
and F q = A q . The corresponding statement for observability grammians 
follows from Lemma [7J by applying it to F q = A q , q G Q and Q 
and by noticing that (A q ® A q ") T 
if and only if ^„ g g A q g) A q is stable. 



A q ®A q ; hence, T iq eQ A 



> Ay is stable 
□ 



Appendix K. 



A 



Proof of Lemma U3i The proof is inspired by the PhD thesis [181 ] . Without 
loss of generality, we assume that E is already balanced and hence Ebai = E . 
Assume that the balanced observability and controllability grammians are of 
the following form. 

"Ai 0" 

p 

We use the notation of the partitioning in ( fl4l) . Moreover, we will use the 
continuous time notation generically, e.g., u(t) will denote either a continuous 
time input or a discrete time input depending on the context. 

Fix an input u G U and a switching signal q G Q and denote by x{t) 
the corresponding state trajectory of E and by x{t) the corresponding state 
trajectory of the reduced order model E. Consider the decomposition x{t) = 
(xi(t) , x 2 (t)) where Xi(t) G R" --1 , and define 



z(t) = A g (t) >2 ix(t) + B q (t), 2 u(t). 
With this notation, consider the following vectors 



X c (t) 



xi{t) + x{t) 
x 2 (t) 



X {t) 



X\(t) — x(t) 
x 2 (t) 



An easy calculation reveals that (with 5 the derivative- or forward shift op- 
erator) 



5X c {t) = A m X c {t) - 
5X (t) = A q(t) X (t) + 





z(t) 

' 

z(t) 



2B q(t) u(t) 



We will show that 
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Lemma 17. 



Afi 2 \\u\ 



> 



f Q X (s) T C T q{s) C q{s) X {s)ds (cant.) 
ZTJo X {s) T C T , s) C q{s) X {s) (disc.) 



(K.l) 



Before proving Lemma H7] notice that C q (t)X {t) = y(t) —y(t), where y(t) 
is the output trajectory of E and ?/(£) is the output trajectory of E. Hence, 
(IK.ip is equivalent to 

\\y-y\\l<^ 2 \\u\\l 

From this Lemma [13] follows. 

In order to prove Lemma [T71 we proceed as follows. Notice that 



5(Xj(t)AX (t)) 



[ 2X (t) T A T q[t) kX {t) + 2f3z(t) T x 2 (t) (cont.) 



Xj(t)AZ t) AA q(t) X (t) 



+2{3X (t) T AT 



?(*) 





z(t) 



+ PMt)\\l ( disc - 



In the derivation above we used that 



A 



' 

z(t) 





z(t) 



Using this and the fact that A satisfies the observability grammian inequality 
(ED, it follows that 



S(Xj(t)AX (t)) 



{ -X {tfC T q{t) C q{t) X (t) + 2f3z(t) T x 2 (t) (cont. 



< <j -X (tfC T q(t) C q[t) X (t) + X (t) T kX (t) 
+2pX (t) T AT (t) ° +P\\z{t)\\l 



(K.3) 



(disc). 
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By noticing that X o (0) =0 and hence 

< Xj(t)AX (t) 

SU r {X T {r)KX {r))\ r=s ds 



XZ(s)AX (s)), 



and combing it with (IK.3[) . it follows that 

0<- f X (s) T Cj {s) C q(s) X (s)ds 
Jo 



+ 2/3 z(syx 2 (s)ds, 
'o 



(cont.) 



(disc.) 



(cont.) 



t-i 



o<-^i ( s fc; 8) c 9(s) i ( s ) 



s=0 
t-l 



+ $>/3X ( S f A 



r 

?(«) 



s=0 

If we can show that 
Lemma 18. 





z(*) 



4/3||u| 



2 J * z(s) T x 2 {s)ds 



> 



Y?-=o^o{s) T A T 







then Lemma fT71 follows. 



(disc.) 



(cont.) 
(disc.) 



Proof of Lemma [73 We split the proof of Lemma [18] into two parts: one for 
the continuous-time case, and one for the discrete-time case. 
Continuous-time 
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Notice that by applying Lemma [TBI with A = A£, S = and using the 
fact that A is a controllability grammian, it follows that 



A^A- 1 + hr l A a A- l B 
-I 



B^ 1 



< 0. 



Hence, 



~x c (t)~ 


T r 


2u(t) 





'^A- 1 + A" 1 A«) A ~ lfl . 



?(*) 



-I 



X c {t) 
2u(t) 



+ M\u(t)\\l-2Xj(t)A- 1 
<4\\u(t)\\l-2Xj(t)A-' 



' ' 

z(t) 



' 

z(t) 



A simple computation reveals that Xj(t)A 1 
d 



' 

z(t) 



^X2(t)z{t), and thus 



^(Xj^A-'XM) < A\\u(t)\\l - 2-x T 2 {t)z{t) 



By noticing that X c (0) = 0, we get that 

** d 



X c {t) T A- l X c {t) = J ^{X c {s) T A- l X c (s))ds 

<4 / \\u(s)\\ 2 ds - 2 I \xl(s)z(s)ds 
Jo Jo P 



Since X c {tf A~ l X c {t) > 



2 / z(s) T x 2 {s)ds < 4/3 / ||ii(s)||!ds<40||ti||! 



(K.5) 



Discrete-time 

By applying Lemma [16] with ^4 = A T q and 5 1 = 5j for the discrete-time 
case, equation f flQ]) for V = A can be rewritten as 



B%hr x B q - 1 



< 0. 



(K.6) 
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Hence, by using f]K.6|) . 



X c (t + l) T A- 1 X c (t + 1) - Xj(t)A- 1 X c (t) 

1 AT\-1 



~X c {t) 


T r 


2u(t) 





At - A" 
^A^A, 



2u(t) 



-2(A gW X c (t) + 2S 5(t) «(t)) T A- 1 
+ 2 r (t)A- 1 «(t)+4||«(t)||» 
< -2(A g(t) X c (i) + 2B q{t) u(t)) T k- 1 



" 

*(*). 

" 

z(t) 



+ z T (t)A- 1 z(t)+A\\u(t)\\l 



Notice that 



2x(t + 1)' 




Xc (t + 1) - X {t + 1) 

A q(t) X c (t) + 2B q(t) u(t) 




A 5(0 X o (t) - 2 



z(t) 



from which it follows that 

A q(t) X c (t) + 2B q{t) u(t) = A q(t) X (t) + 2 



x(t + 1)~ 

*(*) 



By substituting (1K.8|) into (1K.7|) and using that 



and 



T A -1 



(A 9(t) X c (t)+2 J B f , wM (t)) J A 





*(f) 



-(i, (i) I c (t) + 2B ?(i) n(f)) 



T 







(K.7) 



(K.8) 
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it follows that 

x c (t + \) T hr x x c [t + 1) - xJ(t)A- 1 x c (t) 



1 



< -2-X Q {t) T A T q{t) 



1 



< -2-X (t) T A T q{t) 





z(t) 

' 

z(t) 



+4\wt)\\i- p\\m\ 2 

- ^\\z(t)\\ 2 + A\\u(t)\\l 



Since X c (t) T k^X^t) > and X c (0) = 0, (jQJ) can be rewritten as 

< X c (t) T A- 1 X c (t) 
t-i 

= ]T(x c ( s + lfA" 1 *^ + 1) - x^fA-^s)) 



< 







T 



s=0 





4^1 



- 11*00111) + 4M 



From which it follows that 
t-i 

Y,£X {s) T A q{s) 



s=0 





z(s) 



(K.9) 



< 4/3||m| 



(K.10) 

□ 
□ 



Appendix L. 



Proof of Lemma 1J_ In order to present the proof, we will use the following 
auxiliary result. Using the terminology of 17||, define 





"o 


A 1 . 


• A D ' 




~B 1 . 


• B D ~ 




I 


. 


. 




. 


. 


A = 








, B = 








I 


. 


. 




. 


. 



C = [0 d ... C D ] 



It then follows that 





B ' 


. c 






. Denote by T the set of all matrices 



of the form diag(5i , . . . , Sd+i) such that Si are n x n matrices. Denote 
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by T + the subset of all the matrices diag(Si, . . . , <Sd+i) sucri that Si are 
nx n positive definite matrices. In order to define grammians and quadratic 
stability, in [17J expression of the following form were investigated A T X A — X 
and AYA T — Y for X, Y G T + . An easy calculation leads to the following 
proposition. 

Proposition 1. Assume that X = diag(S'i, . . . , Sd+i) £ T + ■ The ith n x n 

diagonal block of A T XA — X is of the form AjSiAi — Si for i = 2, . . . , D and 
it is of the form &i ~ &i f or * = 1- Similarly, the first n x n diagonal 

block of AXA T — X equals E g eQ A q X q+ \A q — X\ and the ith diagonal n x n 
block equals P\ for i — 2, . . . , D + 1. 

Based on Proposition [1] we can show the following. 

M s is quadratically stable =>■ E strongly stable If M s is quadrat- 
ically stable, then for some X G T + , A T XA — X < 0. By Proposition [T] the 
diagonal elements of A T XA — X are E^=2 ^9+1 ~ $l anc ^ ^9 S\A q — S q+ \, 
q G Q. If A T XA — X is negative definite, then so are its diagonal elements 
and hence E^=2 S q +i — Si < and A^SiA q — S q+ i < 0, g G Q. Hence, 
T, q eQ A ^ S ^ A i ~ E^q-Vi < °- Using ^ > $^ 6 q S,+i, it follows that 
E gAySiAq — Si < 0. Then from Lemma [7] it follows that £ is strongly 
stable. 

If V and £} are the controllability and observability grammians of 
Ms, then V and are controllability and observability grammians 
of S and flTZ} holds. 

If V and (more precisely, Pi and Qi) satisfy (|17|) . then they are clearly 
controllability and observability grammians of S. Hence, it is enough to 
show that (JTTJ) holds. To this end, recall that if V and =2 are controllability 
(resp. observability) grammians of Ms, then A T J2A + C T C — J2 < and 
AVA T + BB T — P < 0. From Proposition [T] it then follows that the diagonal 
nxn blocks of A T ^4+C T C-^ are of the form J2 q eQ Qq+i~Qi, A ^Qi A q + 
C q C T q -Q q+l . Hence, E ?eQ Q ?+ i-Qi < 0, A T q Q\\ + C T q C q - Q g+ i < 0. By 
taking the sums of A^Q 1 A q — Q q+ i and by taking into account EneQ Q q +\ — 
Qi < 0, it follows that E ge Q A? q Q x A q + CjC 9 - Q x < 0. From Proposition Q] 
it then follows that the first nxn diagonal block of AVA T + PP T — P equals 
^ g(AgP g+ iA^+5 g S^)— Pi, and all the other diagonal blocks are Pi— P g +i, 
qeQ. Hence, P 1 < P q+1 and E ?eQ (A^+i^ + 5 <?0 - A < 0. Since 
then A,Pi^ < A q P q+l A T q) it follows that E, eQ (A,Pi4f + P^J) - P < 
holds. 
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Ms is minimal •<=>- E is minimal By 17|, M E is minimal if and 



only if it is reachable and observable. The latter conditions are equiva- 

lent to W = ZZo E£? A =i Im Ai k ■ ■ ■ A 2 , n G n and {0} = R« D^ A =i 
kerC ifc A ifcjifc _ 1 • • ■ A il4 for all z = 1, . . . ,D. Here ^l.g+i = A q , A q+ x A = I n , 
q G Q, and A,j = otherwise, Similarly, C\ — and C g = C g _i for 
g > 1. Finally B = [Gj ... G T D+1 ] T and thus G 1 = [B x . . . B D ] 
and G q = for g > 1. It then follows that A i<ik ■ ■ ■ A i2 ^ il Gi 1 = A V G X , if 
v = qi---qi and i x ■ ■ -ih = l(<7i + 1)1 (92 + 1) • • • l{qi + 1)1 or i x ■ ■ -i k = 
l(gi + 1)1(^ + 1) • • • % + l)l(g+l) for some q G Q, and A{^ k ■ ■ ■ Ai 2 ^ 1 Gi 1 — 
otherwise. Similarly, C ife A fe ,i fc _ 1 • • • A hyi = C qi A v , if vq t = q x ■ ■ ■ q h i x ---i k = 
(q x + l)l(g2 + 1) • • • (qi-i + l)l(ft + 1) or and it is zero otherwise. Hence, 
by Remark H] reachability of Ms is equivalent to span-reachability of E and 
observability of Ms is equivalent to observability of E. 

Ms is balanced ==>- E is balanced Assume that V = =2 diagonal, 
then the first nxn block of V = is also diagonal and it is an observability 
and reachability grammian of E. That is, E is balanced. 

M E arises from balanced truncation Assume that V = JS = diag(Ai, .. 
.., A_d + i) and assume that in Procedure @] we discard the n — r smallest singu- 
lar values of Ai. Let us apply balanced truncation to Ms by discarding the 
n — r smallest singular values from Ai, . . . , A^+i. From the formula presented 
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17] it then follows that the resulting uncertain system equals M s . □ 



Appendix M. 

Proof of LemmalM Proof of Part ffl Notice that Y.geQ A g PA g ~ P < is 
equivalent to ^2 q& Qp((^A^PA q ) — P < 0. The existence of a positive definite 
solution to former LMI is equivalent strong stability of E, and the latter LMI 
is equivalent to mean-square stability of E st . 
Proof of Part [2] Notice that 

X)(iVMj + B q B T q ) 

q&Q 
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and 



y](A^^A q + C q C q 



1 \T\ at 1 a \ , i 1 nT\ ' 1 



= £p((-$=0-2(-$=^) + (^cj')(^c*))- 

^ VP q VP 

From this it the first part of the claim follows. Since clearly A q VA T q + 
B q B T q - V < E 96Q (V^ + B q B T q ) - V and A?J2A q + C T q C q - 2 < 
J2 qeQ (Ag£A q + C^C q ) - it follows that if V and £ satisfy ([18}, then 
they are controllability resp. observability of S. 

As for the second part of the claim, if V and =2 are nice controllability 
resp. observability grammians, then they satisfy ( TT8|) and hence they are also 
controllability resp. observability grammians of E st . 

Proof of Part [3] Assume that we apply Procedure H]to grammians V and 
which satisfy (fIS|) . Let S be the state-space isomorphism which renders S 
balanced. Denote the resulting balanced LSS by S. Since E st has the same 
state-space as S, we can apply the state-space transformation to obtain a 
jump-linear system 



J st 



z(t+l) = A e(t) z(t) + B e{t) u{t) 
y(t) = C e{t )z(t) 



where A q = -^=SA q S 1 , B q = -^=SB q , C q = ^C q S 1 . It is then easy to 

see that the matrices (S -1 ) 10 JSS^ 1 = SVS T = A are equal and diagonal 
and satisfy (ITgj) with A q , B q and C q being replaced by SAqS^ 1 , SB q and 
CqS^ 1 , q E Q respectively. Hence they are also grammians of S st , i.e. £ st is 



balanced according to 14|. Finally, if A = diag(o"i, . . . , a n ), <j\ > • • • a n and 
we truncate the singular values a r +i, ■ ■ ■ , &n, then Procedure 0] returns the 
system S = (n, Q, {A q , B q , C q } q£ Q), where A q the is upper left r x r block of 
SAgS^ 1 , B q is formed by the first r rows of SB q , and C q is formed by the 
first r columns of C g <S> -1 . But then the stochastic system 

1 , , , 1 



S s t — 



Kt + 1) = ^=M t) z(t) + ^B e{t) u(t) 
m = ^C e(t) z(t) 
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is easily seen to coincide with the result of applying balanced truncation to 

Proof of Part [4] With a slight abuse of notation, for u G U, v G Q + , 
we will denote by Y(u,v) the value y s (it, q){t), where t — \v\ — 1 and the 
switching signal q such that q(0) ■ ■ ■ q(t) = v. Note that due to the definition 
of y s , the value of F s (u, q)(t) does not depend on the choice of q(l), I > t. 
Hence, Y (u, v ) is well-defined. Define the random variable 

x(0 = v)(u) = { Q otherwige _ 

It is then easy to see that the output process y t of E st satisfies 

v&Q+,\v\=t ^ 

From this, by noticing that P{x{@ = v)) = p l it follows that 



E[y T (mt)}= E im^)ii2>r< 

«eQ+,|«| 



«,^ll 2 . 



Hence, for any (u,q) GWx Q, ^[y T (i)y(i)] > ||F s (w, <?)(£) ||| and thus 

oo 

\\Y*(u,v)\\ 2 2 < E^(^)] < 7 2 Nl2, 

t=0 

from which the statement follows. □ 
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